you are viewing a single comment's thread
view the rest of the comments
[–] 122 points 3 months ago (29 children)

We're destroying the environment for this folks

  • source
  • hideshow 29 child comments
  • [+] -50 points 3 months ago (28 children)
  • [–] 50 points 3 months ago (10 children)

    No one in this post about Google is talking about local LLMs.

  • source
  • parent
  • hideshow 10 child comments
  • [+] -26 points 3 months ago (9 children)

    i was trying to say Local LLMS dont destroy the environment(cause its using the power of your pc instead)

  • source
  • parent
  • hideshow 9 child comments
  • [–] 47 points 3 months ago (5 children)

    Training the models still uses a vast amount of resources

  • source
  • parent
  • hideshow 5 child comments
  • [+] -22 points 3 months ago (4 children)

    well atleast every prompt you ask it wont harm the environment

  • source
  • parent
  • hideshow 4 child comments
  • [–] 17 points 3 months ago* (1 child)

    If you are browsing Piefed you are probably using about 10-20% of your computer's resources (if it is a computer capable of running a 4B model).

    When you question the model and it pegs your system out, that is between 5 and 10 TIMES more resource utilization and power waste just to have a question answered that you could have taken the time to research, improve your own critical thinking skills, and learned something without changing your utilization at all.

    Not counting the training debt.

  • source
  • parent
  • hideshow 1 child comment
  • [+] -6 points 3 months ago* (last edited 3 months ago)

    i forgot about critical thinking, hehe.
    but i hope my use of AI doesnt ruin it that much.
    btw the best respones here.

  • source
  • parent
  • [–] 3 points 3 months ago

    Megacorps don't burn resources for the shake of it. They do it to train/run LLMS.

    If all that running/training is done by the individual instead, the individual is going to be the one burning the resources.

    In fact, it would probably be more resource intensive.

    Since centralization and scale usually improves efficiency.

    Most people don't have computer hardware that was built with the sole purpose of training/running LLMs. LLM data centers do. Purpose-built hardware is more efficient than generic hardware.

  • source
  • parent
  • [–] 16 points 3 months ago (6 children)

    No? If everyone who uses LLMs globally switched over to a local LLM (after buying the necessary hardware), that'd still be a crazy amount of energy usage, just less centralised.

  • source
  • parent
  • hideshow 6 child comments
  • [+] -6 points 3 months ago (4 children)

    nah like using the current Gaming PC/Laptop you have, Like Intel CPU + intergrated graphics or smth.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 6 points 3 months ago (3 children)

    I suppose, but that's a very different class of model. I think a more important question might be whether people actually need LLMs at all.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 3 months ago (2 children)

    whether people actually need LLMs at all.

    this is personal preference ig.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 3 months ago (5 children)

    There are so many better tools for this kind of thing.

  • source
  • parent
  • hideshow 5 child comments
  • [–] -1 points 3 months ago* (last edited 3 months ago) (4 children)

    like what?
    plus i tend to use a search engine more often if i can find what i want.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 3 months ago (3 children)

    For counting letters in a word? That's like a one line expression in Python or JavaScript (and other languages). JavaScript console is right there in your browser.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -1 points 3 months ago (2 children)

    if javascript can do it,tell me how to do it?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 3 months ago (2 children)

    Good to see so many people misunderstanding how local hosting works.

    Running your own local LLM is no worse than running a graphically intensive game like cyberpunk 2077 or red dead redemption 2.

  • source
  • parent
  • hideshow 2 child comments