But in all fairness, it's really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago (1 child)

I was sadly stymied by the fact the rocm driver install is very much x86 only.

  • source
  • parent
  • hideshow 2 child comments