Profile avatar
zackangelo.bsky.social
building ai inference @ mixlayer
8 posts 23 followers 120 following
Posts 4 Comments 4

one of the most slept on capabilities of newer AI models is the ability to call multiple tools in a single shot. here's the newest llama 70b running on mixlayer calling 4 tools (lookup weather in 3 cities and perform some arithmetic)

submitted 76 days ago • 1 comment

Want to play around with chain of thought and some other prompting techniques? I put up a few Mixlayer demos on Meta's Llama 3.1 8b in this blog post. www.mixlayer.com/blog/2024-12...

submitted 78 days ago • 0 comments

Crazy to think that a 1M token context window will be the norm soon. Doesn't look like this model has made it onto HF yet (just a space, no weights), curious to learn more about the sparse attention mechanism. qwenlm.github.io/blog/qwen2.5...

submitted 101 days ago • 0 comments

woke up in a 3am fit of terror last night bc I dreamt I left an 8x a100 gpu cluster running by accident 🫠

submitted 102 days ago • 0 comments