you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 6 hours ago (1 child)

I just want to rent them for my life. I love being a modern serf.

Seriously though, go local or go home. Never paid a single cent for renting a LLM. Any PC that can play video games is fully sufficient to generate text with LLMs.

  • source
  • hideshow 1 child comment
  • [–] 0 points 3 hours ago

    Any PC that can play video games is fully sufficient to generate text with LLMs.

    I am all for local inference, but that is a super ignorant and uninformed take. I hope you are not running around complaining about the hallucinations and bad quality of LLM generated stuff, if your baseline are models that fit in 8 GB of VRAM or something. And no, 16 or even 24 GB wouldn’t bring you close to what the big models can do.

  • source
  • parent