I'm surprised this result (which is essentially a nonuniform version realizable, online classification) was not known. Result says you can make a finite number of mistakes if and only if the class is a countable union of classes with finite Littlestone dimension.

https://arxiv.org/abs/2312.00170