you are viewing a single comment's thread
view the rest of the comments
[–] 0 points 2 hours ago

Any PC that can play video games is fully sufficient to generate text with LLMs.

I am all for local inference, but that is a super ignorant and uninformed take. I hope you are not running around complaining about the hallucinations and bad quality of LLM generated stuff, if your baseline are models that fit in 8 GB of VRAM or something. And no, 16 or even 24 GB wouldn’t bring you close to what the big models can do.

  • source
  • parent