I'd been waiting for a WebGPU LLM inference engine.

https://github.com/mlc-ai/web-llm

Comments

Posting Rules

  • Be respectful to others
  • No spam or self-promotion
  • Stay on topic
  • Follow Bluesky's terms of service