alright, i got my qwen
i had to build a new version of ollama, this must be something interesting in this new model. i'll have to read about it later
first thought: daaaaamn this is fast, it's a 30b going at 30-40 tok/s
i had to build a new version of ollama, this must be something interesting in this new model. i'll have to read about it later
first thought: daaaaamn this is fast, it's a 30b going at 30-40 tok/s
Comments