Another thing about #ollama on #Linux specifically:
There's an installation script, and a lot of how-tos online. They all install it system-wide, create a new user and so on.
But if you just want to run and test as a user, you can. Download " ollama-linux-amd64.tgz" from a github release […]
There's an installation script, and a lot of how-tos online. They all install it system-wide, create a new user and so on.
But if you just want to run and test as a user, you can. Download " ollama-linux-amd64.tgz" from a github release […]
Comments
There's a fork of ollama that provides Vulkan support:
https://github.com/whyvl/ollama-vulkan
No releases yet. But in one of the issues, one user provides prebuilt binaries for Ubuntu:
https://github.com/user-attachments/files/18783362/dist.zip
Do […]
Because CUDA works only on NVIDIA cards new enough that they still provide drivers. And ROCm supports only a small subset of AMD cards.
Vulkan is well supported on just about any GPU or GPU-like device out there, from cheap Android devices up to the largest […]