LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

Ollama now supports AMD graphics cards

ollama.com

Ollama now supports AMD graphics cards

ollama.com

turkishdelight@lemmy.ml to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

Ollama now supports AMD graphics cards · Ollama Blog

ollama.com

Ollama now supports AMD graphics cards in preview on Windows and Linux. All the features of Ollama can now be accelerated by AMD graphics cards on Ollama for Linux and Windows.

But in all fairness, it’s really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

Chat

sardaukar@lemmy.world
link
fedilink
English
arrow-up
7·
1 year ago
I’ve been using it with a 6800 for a few months now, all it needs is a few env vars.

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

7 users / day
126 users / week
286 users / month
667 users / 6 months
5 local subscribers
2.79K subscribers
260 Posts
1.1K Comments
Modlog