I'm now running an LLM using ollama on a Raspberry_Pi 5 with 16 GB ram and 256 GB nvme SSD. Alibaba's qwen2.5 runs acceptably well: see session screenshot below. The Pi is a key component in my current stealth project :) - ThreadSky

romilly-cocking.bsky.social • 33 days ago

I'm now running an LLM using ollama on a Raspberry_Pi 5 with 16 GB ram and 256 GB nvme SSD.
Alibaba's qwen2.5 runs acceptably well: see session screenshot below. The Pi is a key component in my current stealth project :)