Six months after joining @hf.co we’re kicking off the first migrations from LFS -> Xet backed storage for a handful of repos on the Hugging Face Hub.
A few months ago, I published a timeline of our work and this is a big step (of many!) to bring our storage to the Hub - more in 🧵👇
A few months ago, I published a timeline of our work and this is a big step (of many!) to bring our storage to the Hub - more in 🧵👇
Reposted from
jsulz
The year is wrapping up and the first pieces of the Xet Team's infrastructure are moving to prod.
We've done a lot of work since joining @hf.co, and I wanted to share a reading guide to see our progress since we got here.
We've done a lot of work since joining @hf.co, and I wanted to share a reading guide to see our progress since we got here.
Comments
✅ First off, no action needed - this migration is helping us test and scale the infrastructure before a broader rollout
👀🔎 But you can play "spot the Xet logo" - if you see our logo on a file in a repo, that's a file we're serving now!
Download away 🌐
Thanks to @wauplin.hf.co and @celinah.hf.co , we’re gearing up for a full integration with the huggingface_hub library that will make uploads and downloads faster than ever.
Curious how? Check out 👇
Join us on the bleeding edge at 🤗
Ready. Xet. Go.
Am still small but, pilling-up revisions at some important scales could become a thing (for both model and datasets) so, Xet is something I think of a lot since you guys joined HF.
Am just pinging you here, maybe some day will say a more formal Hi, who knows ?