you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 3 months ago (1 child)

RX Vega 56 8GB HBM2, 64GB RAM

That's poor but not horrible. LMStudio has Vulkan compute backend option that works on almost any card. You can also do partial GPU/RAM split giving you total of 72GB and increased performance vs CPU only.

  • source
  • parent
  • hideshow 1 child comment