Lots of RAM and a separate GPU if you can afford the space. I’d target a specific model (say Llama 70b) and figure out system requirements from there.

Comments

Posting Rules

  • Be respectful to others
  • No spam or self-promotion
  • Stay on topic
  • Follow Bluesky's terms of service