But in all fairness, it's really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

all 4 comments

sorted by: hot top controversial new old
[–] 7 points 2 years ago

I've been using it with a 6800 for a few months now, all it needs is a few env vars.

  • source
  • [–] 5 points 2 years ago (1 child)

    That's cool. I've just recently gotten hold of an interesting Ampere system and it's got an AMD card in it. I must give it a spin.

  • source
  • hideshow 2 child comments