you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 7 months ago (8 children)

But wait! They can pay for remote computing time for a fraction of the cost! Each month. Forever.

I fully expect personal computers to be phased out in favor of a remote-access, subscription model. AI popping would leave these big data centers with massive computational power available for use, plus it's the easiest way to track literally everything you do on your system.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 5 points 7 months ago* (last edited 7 months ago) (1 child)

    easiest way to track literally everything you do on your system.

    And ban undesired activities. "We see you're building app to track ICE agents. That's illegal. Your account was banned and all your data removed.".

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 7 months ago (1 child)

    Remote computing is very expensive. It's just the gated (owned by companies) LLMs that are cheap for the final consumer. Training a 2b LLM on remote compute will cost thousands of dollars if you try to.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 7 months ago

    2B is nothing, even 7B is tiny. Commercial API-based LLMs are like 130-200 billion parameters.

    I mean yeah, training a 7B LLM from scratch on consumer-grade hardware could take weeks or months, and run up an enormous electric bill. With a decent GPU and enough VRAM you could probably shorten that to days or weeks, and you might want to power it on solar panels.

    But I haven't calculated what it would take to do on rented compute.

  • source
  • parent
  • [–] -2 points 7 months ago* (1 child)

    This is true but at the current computer prices, nowhere near as bad as it sounds. I spend £100/year or thereabouts for GeForce Now, and

    • there's no way I could play games on a £500 laptop that I renew every 5 years,
    • no way that a £1000 laptop could get me to play AAA games for more than 1-2 years
    • and sure, I could play games on a £2000 laptop, but no way that will last me 20 years.

    If you have a life and can't play any more than 25 hours a week, the value proposition right now is great - there's no viable alternative that allows you to keep playing AAA games for the equivalent of £100/year.

  • source
  • parent
  • hideshow 1 child comment