Profile avatar
tbepler.bsky.social
Scientist and Group Leader of the Simons Machine Learning Center @SEMC_NYSBC. Co-founder and CEO of http://OpenProtein.AI. Opinions are my own.
22 posts 275 followers 37 following
Getting Started
Active Commenter

Excited to share PoET-2, our next breakthrough in protein language modeling. It represents a fundamental shift in how AI learns from evolutionary sequences. 🧵 1/13

🧬 Announcing PoET-2: A breakthrough protein language model that achieves trillion-parameter performance with just 182M parameters, transforming our ability to understand proteins.

Can we learn protein biology from a language model? In new work led by @liambai.bsky.social and me, we explore how sparse autoencoders can help us understand biology—going from mechanistic interpretability to mechanistic biology.

A flexible framework for fast and accurate segmentation of filaments and membranes in tomograms and micrographs - the TARDIS manuscript is now live @biorxivpreprint.bsky.social ! Thanks to hard work by Robert Kiewisz and our many collaborators! www.biorxiv.org/content/10.1...

I'll be talking about shrinking protein language models with #PoET and protein engineering at openprotein.ai tomorrow at A*STAR's Bioinformatics Institute. If you can't make it, I'll also be presenting at the Berger Lab seminar @mitofficial.bsky.social on Wednesday!

Yet more evidence that transfer learning of sequence-only PLMs does not benefit from scale beyond 650M params 🧵