I recently setup Ollama because I’m interviewing for a job that seems pretty positive on AI usage and I wanted to get some experience using it so I could actually speak about it in an upcoming interview.
Something that I’ve noticed though, is that my GPU usage is basically pinned around 100% now, even when not using the AI. I’m getting regular freezes that last anywhere from a few seconds to about a minute when just running a browser and a lightweight game like Oldschool Runescape.
I have to assume the daemon is using all my resources even when I’m not running anything that uses the AI? I ended up uninstalling, but I’m curious if anyone here has advice on setting this up to not be so detrimental to regular usage of my computer.
Please don’t use Ollama. Consider switching to llama.cpp instead, it’s what Ollama uses under the hood and you’ll have much finer control over what exactly it’s doing so it’ll be much easier to troubleshoot things like this.
it’s what Ollama uses under the hood
Actually they have their own, shittier engine now. They didn’t credit llama.cpp while using that for quite a while. Agree with don’t use if at all possible (unfortunately some third party softwares need it, good sign to use something else, but needs must where the devil drives)
Thank you, what an eye opener. Bye ollama
https://www.reddit.com/r/LocalLLaMA/comments/1u6s6pm/stop_using_ollama/
I personally use LM Studio for local models and used openwebui when I wanted a different mistral api model
Thanks! I’ll take a look at this and install one of these tomorrow to see if they’re better.
This sounds like the AMD driver bug I’m hitting.
