Profile avatar
fairseq2.bsky.social
FAIR Sequence Modeling Toolkit 2
8 posts 17 followers 8 following
Getting Started

πŸš€ Transform your LLM post-training with fairseq2! We make complex post-training into a breeze, so that you can make fairseq2 your paper machine! Feel free to check our tutorials out: - SFT: facebookresearch.github.io/fairseq2/sta... - DPO: facebookresearch.github.io/fairseq2/sta...

This project was made feasible by the excellent open-source LLM training library @fairseq2.bsky.social; I highly recommend giving it a look! It made both SFT and DPO a piece of cake 🍰

πŸš€ Big news for LLM researchers! #fairseq2 now has native support in #vLLM. Deploy your fine-tuned language models with vLLM in just one command for lightning-fast performance. Ready to accelerate your research like in FAIR? Check this out: facebookresearch.github.io/fairseq2/sta...

πŸ–ΌοΈ A gallery of open-source projects and papers powered by #fairseq2! πŸš€ Seamless Communication and Large Concept Models are 2 vivid examples that showcase the potential of what we are building. More exciting FAIR research built on fairseq2 is on the way!

πŸ‘‹ Hello world! We’re thrilled to announce the v0.4 release of fairseq2 β€” an open-source library from FAIR powering many projects at Meta. pip install fairseq2 and explore our trainer API, instruction & preference finetuning (up to 70B), and native vLLM integration.