Last August, I chatted with
@dlwh.bsky.social
about the need for an open-source set of scaling law checkpoints!
Since then, I was lucky to play a (small) role in building Marin-8B. Check out the model (including intermediate checkpoints) here:
https://huggingface.co/marin-community/marin-8b-base
@dlwh.bsky.social
about the need for an open-source set of scaling law checkpoints!
Since then, I was lucky to play a (small) role in building Marin-8B. Check out the model (including intermediate checkpoints) here:
https://huggingface.co/marin-community/marin-8b-base
Comments
And about the Models we are releasing in @dlwh.bsky.social's training retro: https://marin.readthedocs.io/en/latest/reports/marin-8b-retro/