But in all fairness, it's really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 2 years ago

I've been using it with a 6800 for a few months now, all it needs is a few env vars.

  • source