If other people are attending in person and you're making it clear that you're going to attend a different way, yes.
If the class is being held only online and you're going to attend, no. In that case, you'd say "I'll attend the online class".
If you have a question about the English language and would like to ask one of our many English teachers and language experts, please click the button below to let us know: