As I was using LLMs at work (I never use LLMs for personal projects), a question occurred to me:

What in the fuck are these new data centers supposed to actually do?

The enterprise users are all in on having LLMs write 300% of the code. And yet, both OpenAI and Anthropic are still giving these "$200 gets you $10 000 in API costs" subscriptions to every victim of AI psychosis.

Why do we have RAM, hard disk, SSD, GPU and CPU shortages and no "token shortage"?

I mean, we all know the answer, these are the offerings for the robot god, but like how in the fuck are they still obtaining loans for this shit?

all 32 comments

sorted by: hot top controversial new old
[–] 1 point 30 minutes ago*

A few things:

  • I think nation states anticipate this new wave of machine learning will enable unfathombly large surveillance and a new age of hurk cyber warfare.
  • Some investors seem to believe that basically all fields will adopt "ai" with the same enthusiam and level as software. The film industry alone would need a hideous amount of computer hardware if that disturbing fantasy of everyone living in their own solipsistic culture bubble came to life.
  • Humanoid robot wierdos are anticipating applying deep learning and computer vision to copy movements etc from humans with camera's strapped to their faces (part of the reason glasses are being pushed again). Some of the anticipate enormous fleets of robots doing everything from manufacturing to warfare. This would need a lot of compute
  • Nobody actually has any idea how to direct businesses or run nations, and a considerable amount of people at just following everyone else because everyone else can't be wrong.

Oh also it's entirely possible to make huge amounts of money in a bad idea as long as you get out first. I suspect a lot of investors and banks are anticipating being that person. Capitalism is hilarious.

  • source
  • [–] 2 points 7 hours ago

    Maybe it's to keep the existing assets from cratering in value. Storage and RAM prices have gone up in value, if all those assets returned to their sane values then many more loans would be upside down.

  • source
  • [–] -2 points 5 hours ago (3 children)

    The large tech companies (Meta, Microsoft, Google, Amazon) all know that software companies are going to go bankrupt. People will start creating things like Windows with LLM. Windows and software is obsolete. So these big companies that are sitting on hordes of cash, and know their days are limited, need to make a pivot. They also know that all the countries of the world are deeply in debt, and inflation is going to continue. Cell phones are becoming expensive, and will only get worse as inflation continues, and countries start devaluing their currencies. So the push is going to be (and Elon Musk said this flat out on Joe Rogan), new inexpensive devices will replace cellphones. They wont have a CPU or much RAM, because all the apps will be cast from Data Centers. The world will return to the terminal servers of the 70s. So Data Centers will have a use, for steaming all the apps. But the other thing is that the worldwide electrical grid is old, and can't handle all the new power that's needed for the Data Centers, and Electrical Vehicles. I saw a millionaire call the rebuilding of the Electrical Grid that's taking place a modern day Industrial Revolution. So,,, the bigger part behind each data center is going to be the SMR (Small Modular Reactors) The small modular reactors are built in the same style as the nuclear reactors inside a nuclear submarine, or an aircraft carrier. They are mass produced, built like interlocking Legos, self contained, and run for 20-30 years without needing any more nuclear fuel added. They will power the data centers, and MORE IMPORTANTLY, they will be connected to the grid! So these large companies like Microsoft who bough the 3 mile Island reactor, will become hybrid tech companies, selling app subscriptions, cloud space, utility companies, selling electricity back into the system. It's also important to get the cost of electricity down using the SMR, because the average person is going to be a lot poorer in the future. Here you go, the full scoop, you won't hear on the news.

  • source
  • hideshow 3 child comments
  • [–] 4 points 4 hours ago

    People will start creating things like Windows with LLM.

    No, they won't.

    and Elon Musk said this flat out on Joe Rogan

    lol

    I saw a millionaire call the rebuilding of the Electrical Grid that’s taking place a modern day Industrial Revolution.

    lol encore

    Here you go, the full scoop, you won’t hear on the news.

    lol a third time

    Go do your own research somewhere else.

  • source
  • parent
  • [–] 12 points 23 hours ago* (1 child)

    I think it is a combination of VCs really believing this is the next big gold rush and radical innovation which will change the world plus a few true believers who think we need all the ... compute (I dislike the word) to run the acausalrobotgod who will fix all our problems (and 'We' need to prepare so China doesnt build it first).

    To go back to the first group, when they say 'dont get left behind' they are bot addressing you or me, but other capitalists (as in people with money, not just people who believe the ideology is best)

    Edit: wow this question attracted a lot of conspiracy theorists.

  • source
  • hideshow 1 child comment
  • [–] 9 points 20 hours ago

    I'm purging the worst of the conspiracy theorists (which I'm sure they'll love)

    I considered posting a reminder that we do analysis here, not weirdo daydreaming, but fuck it anyone who doesn't know where the line is deserves a ban

  • source
  • parent
  • [–] 8 points 1 day ago

    mass surveillance, and dynamic pricing/ad targeting.

  • source
  • [–] 12 points 1 day ago

    It's a bubble in a specific subcategory of commercial real estate, and commercial real estate usually eats shit first when a recession hits. The tech essentially serves the same purpose as American consumer credit did in the runup to 2008, just one step removed.

  • source
  • [–] 3 points 23 hours ago

    There is also a token shortage, Anthropic at least started noticeably throttling users like 6ish months ago.

    Not saying there is demand at API price points since the majority of use still comes from sub's, but still.

  • source
  • [–] 21 points 1 day ago* (last edited 1 day ago) (3 children)

    My personal conspiracy theory is the AI companies are being used as a front for a new Manhattan Project for the surveillance dragnet. All those flock camera feeds gotta go somewhere. Imagine being able to look up who, what, where, and when (and infer why) for any person or place in the US, linking online interaction to physical places in near-real time.

    Here's who it's being built for.

    ETA: What I see happening over the next decade, the AI bubble 'pops,' government quietly absorbs the (by then) mostly complete facilities and hardware as part of the bailout, then news outlets go silent about data centers and ICE activity while we fall deeper into a fascist hellpit.

    Imagine Hitler's reign, but this time there will be no Anne Frank's.

  • source
  • hideshow 3 child comments
  • [–] 8 points 1 day ago (1 child)

    I think you're right. There is this constant need for governments and the elite in general to keep tabs on the population. They need to detect dissidents that arranges protests, generate push back, are whistleblowers and just people who are somehow a threat to their power structures. Our online activities through phones and computers are presumably already surveilled and is used to profile us. Your LG tv is listening to everything you say by the way and I'm sure they are not alone. That combined with camera footage of physical activity/presence just fortifies their hold on the population further.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 8 points 1 day ago

    My theory is that the data centers are just shell companies for farming tax credits. The various gov officials are all NDA'd and can't won't say what kind of deals they cut nor the kickbacks they're harvesting.

  • source
  • [–] 12 points 1 day ago

    They are for training new models, not running existing ones

  • source
  • [–] 13 points 1 day ago

    Because the rich people that have invested into it want AI to be too big to fail. That way we're forced to keep moving forward on AI, and the rich can achieve their dream of not paying workers.

  • source
  • [–] 8 points 1 day ago (2 children)

    Paying contractors

    Im like 99% sure those are the only people profiting here. Data center electricians make bank to do mostly brain dead copy-paste underground

  • source
  • hideshow 2 child comments
  • [–] 7 points 1 day ago

    An electrician acquaintance of mine was on a gig early in the year essentially building open-air server racks that were then covered with huge tents, a la Tesla's long-standing "temporary" structure in Fremont. I would never have believed him if he hadn't taken pictures and video.

  • source
  • parent
  • [–] 7 points 1 day ago

    They pre buy the memory stock years in advance with IOU money.

  • source
  • For the rich to create a panopticon to keep us In check...and also to charge for knowledge they did not earn or work for

  • source
  • [+] -5 points 1 day ago (2 children)
  • [–] 0 points 1 day ago (4 children)

    Not to sound like a conspiracy theory, but after the Russian bot farm thing I think this is a race to have the means to Astro turf the Internet for propaganda.

    I think we are going to end up with infranetworks, regionally and nationally to avoid this. And I fear that the only way to confirm that someone is not a bot soon will be ID or some sort of biometrics. I think this is a controversial take, but I’d support a non-anonymous internet/social media alternative if it meant everyone I talk to is a human.

    As for a more optimistic take…. I’m sure there’s a lot of complex science shit that instead of actually mindfully researching and experimenting with, can instead just be brute forced. Kinda like those videos where they train “AI” to play racing games or Mario levels, but letting it randomly attempt it thousands of times — and eventually it even beats humans playing it in time and efficiency. Maybe we can use AI to generate more efficient machines?….

    I think we are at the point where AI would be okay enough to do simple shit like simplified farm and factory work, low stakes stuff where it fucking up can’t actually have that severe of consequences. That’d require sweeping economical and social reforms to tackle unemployment, and that’s too optimistic for me. This probably won’t get us to a post scarcity society, but it could make a lot of things very trivial and cheap… if introduced ethically. There might be a point where there’s a lot of people that won’t/can’t get a job, many that shouldn’t need to get a job, and what to do with them. Not everyone can be the guy that fixes and builds the AI. Maybe being unemployed will become not a big deal

  • source
  • hideshow 4 child comments
  • [–] 9 points 1 day ago* (last edited 1 day ago) (2 children)

    If the Russian Bot Farm thing you're talking about is Ukraine bombing a data center and seeing 90% fewer right wing posts, I regret to inform you that it wasn't accurate [bluesky thread source]

    The bots they were talking about were search crawler bots from Yandex. Actual Twitter/X bots saw no change in traffic.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 1 day ago (1 child)

    Admitted speculation:

    I did, however, notice of my own accord that I had 4 days with zero scam calls instead of my usual 10-15, which in retrospect looking back corresponds with when a bunch of Russian services went down. I suspect that the automated crawlers and VOIP systems and aggregators perform a background hum of utility for scam and troll services that makes them much less effective in their absence.

  • source
  • parent
  • hideshow 1 child comment