you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 day ago (1 child)

Yep, we're paying for answers we know are wrong, using the currency of environmental health. It's probably the dumbest thing I've seen humanity do.

People who use the technology need to use things like AnythingLLM for running answer machines locally (yes, AnythingLLM can go online, search websites, and do GPT style answering)... and something like Kolbold.cpp (also run locally) for creative writing tasks.

AnythingLLM is very simple to set up, Kolbold.cpp has tutorials on YouTube and is far less restrictive than ChatGPT. Both avoid interacting with AI data centers (now the available models have already been trained).

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 1 day ago

    Self hosted definitely is the way to go. I have a second hand Intel nuc + nvidia p100 setup, and its more than enough for what I need it to be. And it only uses 250w when im using it, I turn it off when I'm done. Plus my power is all my own solar, so effectively free.

  • source
  • parent