Here’s a nice reddit post showing how quantization affects benchmarking results:

https://www.reddit.com/r/LocalLLaMA/s/j1xBRuohPr
Post image

Comments

Posting Rules

  • Be respectful to others
  • No spam or self-promotion
  • Stay on topic
  • Follow Bluesky's terms of service