you are viewing a single comment's thread
view the rest of the comments
[+] 2 points 4 months ago* (last edited 1 month ago) (1 child)
  • [–] [S] 3 points 4 months ago

    It depends on what precision you run it at. For 4 bit, you need at least 16 GB VRAM and ideally 24 GB to be comfortable, for the full 16 bit you'd need at least 54gb. A RTX 4090 is minimum. I've got 64gb myself, so I can run 8 bit quant comfortably.

  • source
  • parent