New version alert! We've officially released NNsight 0.4, which you can now install with pip. If you haven’t yet tried out NNsight 0.4, here’s what’s new: - ThreadSky

About ThreadSky

ndif-team.bsky.social • 28 days ago

New version alert! We've officially released NNsight 0.4, which you can now install with pip.

If you haven’t yet tried out NNsight 0.4, here’s what’s new:

Comments

ndif-team.bsky.social•28 days ago

🔍 Coherent Error Messages: Improved error messaging to be more descriptive and line specific.

ndif-team.bsky.social•28 days ago

⚡ vLLM Support: Investigate models from the vLLM library with NNsight, making inference more efficient and scalable for real-world applications.

ndif-team.bsky.social•28 days ago

📝 Syntax Updates: You can now use Python if statements and for loops during NNsight’s tracing context. Plus, no more need for .value calls!

ndif-team.bsky.social•28 days ago

🔄 Multiple Token Generation: Apply interventions to all generated tokens with .all(), streamlining the multiple token generation process.

ndif-team.bsky.social•28 days ago

🌊 Streaming: Locally access and manipulate values during remote execution using .local()

ndif-team.bsky.social•28 days ago

Note: NDIF's remotely-hosted models are now running on NNsight 0.4. You will need to update your NNsight version before running experiments remotely! 🎉

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply