all 5 comments

sorted by: hot top controversial new old
[–] 6 points 4 months ago (1 child)

How does it compare to gemma4?

  • source
  • hideshow 1 child comment
  • [+] 3 points 4 months ago
    [+] 2 points 4 months ago* (last edited 3 weeks ago) (1 child)
  • [–] [S] 3 points 4 months ago

    It depends on what precision you run it at. For 4 bit, you need at least 16 GB VRAM and ideally 24 GB to be comfortable, for the full 16 bit you'd need at least 54gb. A RTX 4090 is minimum. I've got 64gb myself, so I can run 8 bit quant comfortably.

  • source
  • parent