▲ 80 ▼ Ollama now supports AMD graphics cards (ollama.com) submitted 2 years ago by turkishdelight@lemmy.ml to c/localllama@sh.itjust.works 4 comments fedilink hide all child comments But in all fairness, it's really llama.cpp that supports AMD. Now looking forward to the Vulkan support!
[–] sardaukar@lemmy.world 7 points 2 years ago I've been using it with a 6800 for a few months now, all it needs is a few env vars. permalink fedilink source
[–] stsquad@lemmy.ml 5 points 2 years ago (1 child) That's cool. I've just recently gotten hold of an interesting Ampere system and it's got an AMD card in it. I must give it a spin. permalink fedilink source hideshow 2 child comments replies: [–] stsquad@lemmy.ml 1 point 2 years ago (1 child) I was sadly stymied by the fact the rocm driver install is very much x86 only. permalink fedilink source parent hideshow 2 child comments replies: [–] turkishdelight@lemmy.ml [S] 2 points 2 years ago It's improving very fast. Give it a little time. permalink fedilink source parent
[–] stsquad@lemmy.ml 1 point 2 years ago (1 child) I was sadly stymied by the fact the rocm driver install is very much x86 only. permalink fedilink source parent hideshow 2 child comments replies: [–] turkishdelight@lemmy.ml [S] 2 points 2 years ago It's improving very fast. Give it a little time. permalink fedilink source parent
[–] turkishdelight@lemmy.ml [S] 2 points 2 years ago It's improving very fast. Give it a little time. permalink fedilink source parent
all 4 comments