velezbeltran.bsky.social - Profile | ThreadSky | a Reddit-style client for Bluesky

First 11 chapters of RLHF Book have v0 draft done. Should be useful now. Next: * Crafting more blog content into future topics, * DPO+ chapter, * Meeting with publishers to get wheels turning on physical copies, * Cleaning & cohesiveness rlhfbook.com

submitted 2 days ago • 0 comments

🔥 Benchmark Alert! MotifBench sets a new standard for evaluating protein design methods in motif scaffolding. Why does this matter? Reproducibility & fair comparison have been lacking—until now. Paper: arxiv.org/abs/2502.12479 | Repo: github.com/blt2114/Moti... A thread ⬇️

submitted 8 days ago • 1 comment

The HuggingFace/Nanotron team just shipped an entire pretraining textbook in interactive format. huggingface.co/spaces/nanot... It’s not just a great pedagogic support, but many unprecedented data and experiments presented for the first time in a systematic way.

submitted 8 days ago • 0 comments

I just wanted to see what it looked like 😭

submitted 9 days ago • 0 comments

Good God, please. I just want some gradients that don't vanish 😭

submitted 11 days ago • 1 comment

I was hoping that recent events would lead to a mass exodus from X. Many have left, but most of the ML and LLM people have not. I have lost a lot of respect for the ML community.

submitted 23 days ago • 9 comments

Now that bluesky has gifs (it didn't work?), I can share (again) my educational notebook on discrete flow matching (by Itai Gat et al.). Also please check the original article and official implementation by Meta! 🐍 github.com/gle-bellier/... 🐍 github.com/facebookrese... 📄 arxiv.org/abs/2407.15595

submitted 23 days ago • 1 comment

Really excited about this! We note a connection between diffusion/flow models and neural/latent SDEs. We show how to use this for simulation-free learning of fully flexible SDEs. We refer to this as SDE Matching and show speed improvements of several orders of magnitude. arxiv.org/abs/2502.02472

submitted 23 days ago • 0 comments

I have a sinking feeling that by 2029 I'm going to be faking a British accent so no one will think I was one of the Americans working on AI during the regime.

submitted 25 days ago • 11 comments

NGL, it's kind of surprising that more people haven't migrated here, especially given what Musk has been doing these days. I don't get it.

submitted 25 days ago • 0 comments

Since everyone wants to learn RL for language models now post DeepSeek, reminder that I've been working on this book quietly in the background for months. Policy gradient chapter is coming together. Plugging away at the book every day now. rlhfbook.com/c/11-policy-...

submitted 26 days ago • 2 comments

Please stop anthropomorphizing language models, it makes them feel really bad

submitted 29 days ago • 3 comments

This comments section is the first time I've felt even a shred of hope in eight days.

submitted 30 days ago • 605 comments

Nazi salutes and speaking at neo-Nazi rallies seems bad. There's history that we should learn from.

submitted 33 days ago • 3 comments

Something I really like about NLP research is that it makes everything super intuitive. This week I have been thinking about variational inference in NLP and a lot of the things that seemed to require mathematical intuition just become trivial when thinking about language. So cool:)

submitted 33 days ago • 0 comments

One thing about me is that I will fight Nazis until I’m six feet in the ground.

submitted 35 days ago • 4407 comments

Every day things are going to become a bit stupider and more evil than the previous day, and there is no foreseeable end to that trend. Using the taxpayer funds to pump your crypto? Go ahead. The next day will bring something worse.

submitted 35 days ago • 8 comments

New randomized, controlled trial by the World Bank of students using GPT-4 as a tutor in Nigeria. Six weeks of after-school AI tutoring = 2 years of typical learning gains, outperforming 80% of other educational interventions. And it helped all students, especially girls who were initially behind.

submitted 43 days ago • 15 comments

Does anyone have any good resources to learn about quantization? Any essential papers to read and resources about how to use/quantize models in practice are greatly appreciated!

submitted 62 days ago • 0 comments

1-> 2 -> 3 -> 3.5 -> 4 -> 4o -> o1 -> o3 I guess we need AGI just to figure out how to name things

submitted 69 days ago • 8 comments

If you are into ML theory (RL or not) with a proven track record, and you are interested in an industry research position, PM me. Feel free to spread the word.

submitted 71 days ago • 3 comments

🧵 Excited to share #Echidna, a Bayesian framework for quantifying the impact of gene dosage on phenotypic plasticity: tinyurl.com/296kf7hf! With @elhamazizi.bsky.social and @mingxz.bsky.social, we integrate scRNA-seq & WGS to uncover how CNAs drive tumor evolution and transcriptional variability.

submitted 72 days ago • 2 comments

Proud of this work spearheaded by the phenomenal @jlfan.bsky.social and @mingxz.bsky.social in collaboration w/ Ben Izar! The past 3 years we've worked hard to unravel how #CNVs shape #tumor phenotypic plasticity seen in #singlecell #RNAseq data ➡️ #Echidna 🦔

submitted 72 days ago • 1 comment

Hello! We will be presenting Estimating the Hallucination Rate of Generative AI at NeurIPS. Come if you'd like to chat about epistemic uncertainty for In-Context Learning, or uncertainty more generally. :) Location: East Exhibit Hall A-C #2703 Time: Friday @ 4:30 Paper: arxiv.org/abs/2406.07457

submitted 78 days ago • 0 comments

I'm on my way to #NeurIPS2024. On Friday I'm going to present my latest paper with Yuval Benjamini. The gist is in the comments, and come chat with me to hear more!

submitted 79 days ago • 1 comment

The circuit hypothesis proposes that LLM capabilities emerge from small subnetworks within the model. But how can we actually test this? 🤔 joint work with @velezbeltran.bsky.social @maggiemakar.bsky.social @anndvision.bsky.social @bleilab.bsky.social Adria @far.ai Achille and Caro

submitted 79 days ago • 2 comments

I have been a little bit scarce on social media in the last few months. Some of that has just been from being busy at work, but some of it has had to do with my father's passing. He hated the very idea of social media, but he religiously followed my Twitter, and then Bluesky, feeds. /n

submitted 82 days ago • 5 comments

We are thrilled to share #Decipher 🔍! Extremely proud of Achille and Joy for leading the development of this creative #ML tool combining VAEs with deep exponential models for comparing disease & healthy trajectories ➕ applying it to study leukemic onset! biorxiv.org/conte…

submitted 470 days ago • 1 comment

We're hiring! We have a staff scientist position open for graduating PhDs and postdocs. If you're excited about single-cell omics in cancer (scRNA, scATAC, scWGS, CITE, spatial—we've got it all), consider applying! We have great people, data, and resources, and welcome visa sponsorships.

submitted 85 days ago • 0 comments

I wanted to make my first post about a project close to my heart. Linear algebra is an underappreciated foundation for machine learning. Our new framework CoLA (Compositional Linear Algebra) exploits algebraic structure arising from modelling assumptions for significant computational savings! 1/4

submitted 85 days ago • 3 comments

Thank you Nature and @anilananth.bsky.social for this great feature on LLMs and AGI (and for highlighting our work arxiv.org/abs/2406.03689)

submitted 86 days ago • 0 comments

From our lab finally I convinced Yuli Slavutsky (generalization/uncertainty/robustness) @yulislavutsky.bsky.social and Claudia Shi (science of LLMs and AI safety) @claudiashi.bsky.social to use bluesky. Go give them a follow! 😁

submitted 86 days ago • 0 comments