Starting my first official training run on the path to developing my own BERT-like foundational model. Trying to manage my expectations but I still believe that this model will be a few percentage points better than its counterparts trained with MLM. Orion I is ready for launch.

Comments