195
you are viewing a single comment's thread
view the rest of the comments
[-] zalgotext@sh.itjust.works 12 points 3 days ago

We have computing power in our pockets a million times more powerful than we used to send man to the moon, why do you think we'll never have enough power?

Not the person you replied to, but I have thoughts on this point in particular:

  1. Consumer devices have started to slow down their performance improvements because we're bumping up against the limits of physics
  2. People/corporations with way more money than the average consumer will always be able to run something orders of magnitude more powerful. Any advances that improve things for the average consumer will improve things for rich people/corporations even more.
  3. Training an LLM isn't really even about compute speed, it's about access to good training material. The average consumer can't afford to buy (or pirate) every book in existence like a rich person/corporation can. An average person doesn't have the ability or time to curate their own training data, but rich people/corporations do.
[-] humanspiral@lemmy.ca 1 points 2 days ago

Training an LLM isn’t really even about compute speed, it’s about access to good training material.

Consumer can't train from scratch but can fine tune/modify open weights model with their data. There is significant open source training material available, without needing/wanting Harry Potter knowledge.

this post was submitted on 27 Apr 2026
195 points (96.7% liked)

Programming

26746 readers
288 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 2 years ago
MODERATORS