188

The reality of how much damage AI mania is doing to our ability to run institutions effectively.

top 23 comments
sorted by: hot top new old
[-] XLE@piefed.social 69 points 3 days ago* (last edited 3 days ago)

On several occasions, we’ve been exposed to folks that have been sort of lukewarm on our main offerings, but they really, really wanted to use AI to perform a natural language query on their data. And we thought “Okay, if you really want to see it, maybe we can caveat this appropriately and show you what it might look like.”

This was a terrible mistake. It backfired in the most predictable way imaginable – every lukewarm client that saw the chatbot in action, even with us telling them that it was not going to accomplish what they wanted, wanted to buy it immediately. Every other consideration, including millions of dollars that we could plausibly help them achieve by non-AI means, was swept aside. It was like a dark and terrible force seized control of their limbs, plunged their hands into their own chests, and presented their still-beating credit cards to us in grim supplication.

The writing here (and everywhere) is phenomenal, and this section echoes something I've seen Cal Newport say before, something along the lines that somebody with no technical knowledge sees one neat trick and suddenly assumes AI will turn into a superintelligence deity.

[-] HaraldvonBlauzahn@feddit.org 9 points 2 days ago* (last edited 2 days ago)
[-] XLE@piefed.social 11 points 2 days ago

Warnings about it being “early days” and “hallucinations” both anthropomorphise the bot and provide ready-made excuses for when one of its constant failures are noticed.

Three years later and the "early days" routine is still going strong. Who would have thought?

[-] MangoCats@feddit.it 8 points 3 days ago

What AI "decision making" does in our processes is: write the reports exactly like the procedure says they should be written, and fills them with whatever you want to hear - looking up convenient references to back up your opinions. You probably should double check the references yourself to be sure they actually exist (though I think AI is getting better at checking its own work for things like this lately) - but... yeah. Ask it once and it will give you "an opinion" that doesn't take into account all of the factors that matter to you. So, as you explain all the factors, it also becomes obvious what you want to hear, so after several rounds the obliging AI eventually not only "sees things your way" but can pile on the BS as deep as you ask it to to back up those opinions. What would have taken days to research and write can be done in an hour or so.

[-] Elting@piefed.social 7 points 2 days ago

It is the ultimate corporate yes-man that they could never quite get in a human. They have built it for C-suites who have control of the money but not their own faculties.

[-] avidamoeba@lemmy.ca 6 points 2 days ago* (last edited 2 days ago)

This is to say that we’re facing a coordination problem around executives being honest around the AI gains they’ve witnessed – if they co-operate, they keep their jobs. If they defect, they will possibly be fired by their embarrassed peers (who have now been implicitly called liars, cowards, or incompetents) and then replaced with someone that will toe the line anyway. If they could all admit the truth at once there might be some hope, but there is no way to coordinate that event.

I think it's interesting to notice that this is not AI-specific. He kinda alludes to that in a different context but I think it's important for people in the industry (and any industry really) to understand. This is driven by the incentives built into the system. Specifically the competition for profit. Whenever there's a thing (technology, process, method) that promises significant profit, everyone and their mother jumps on it. For the simple reason that if they don't, they're getting replaced by someone who would. For the simple reason that if they don't jump in, capital is going to leave their company and enter another one that promises to jump in, and therefore has higher expected profit. This can look as simple as large investors dumping your shares for the shares of a different company, sending your stock price in steep decline. Everyone competes for capital which requires competition for growing profits. Capital goes where the expected profits are higher. Without capital, firms can't hire people and buy what they need to conduct business and create new products. This incentive makes it very difficult to avoid a situation like the one above. We've seen this in corporations with the move to the cloud, with outsourcing development to CHWTIA and so on.

[-] AlteredEgo@lemmy.ml 2 points 1 day ago

Whenever there’s a thing (technology, process, method) that promises significant profit, everyone and their mother jumps on it.

Chaos is a ladder lol. I suspect AI struck at an especially bad time. With smartphones, cloud, blockchain and other hype bullshit it didn't matter that much. But currently economy is illusionary, supported by printing money, overheating, and massive amounts of money seek ROI. All this since 2008. The billions of economic power slammed into AI is being spend on people going around preaching the gospel of AI to businesses. And this was before the technbros backing Trump have moved to trying to purposefully wreck and scam the US and global economy to usher in a new world order from the ashes.

So in some ways technology hype is normal, but the current environment might influence the mental state of people drastically.

I quite like LLMs for what they are. I wish we could see this amount of investment in technological development and hardware breakthroughs without the AI psychosis and insane race to adopt it immediately.

[-] andrewrgross@slrpnk.net 19 points 3 days ago

I wish there were more concrete facts, but a good article nonetheless.

[-] ripcord@lemmy.world 39 points 3 days ago

OK

  • More than 10 billion tons of concrete are manufactured annually
  • The 185 meter high and 2310 meter long Three Gorges Dam is made from concrete
  • Thomas Edison had 49 concrete-related patents
  • The Romans built the Pantheon using concrete
[-] svcg@lemmy.blahaj.zone 8 points 2 days ago

These facts have really cemented my respect for the material.

[-] shrugs@piefed.social 1 points 1 day ago

I'm inclined to beton that!

[-] svcg@lemmy.blahaj.zone 1 points 1 day ago

You can't find quality puns like that off the RAAC!

[-] sbv@sh.itjust.works 9 points 3 days ago

Woah woah woah. Writers are supposed to support their assertions now? But what about the vibes?!

[-] MangoCats@feddit.it 3 points 3 days ago

Give it a vibe to document the support, it can do that - it can even do it in non-hallucinatory fashion, if you tell it to.

[-] FauxLiving@lemmy.world 2 points 3 days ago

Exactly!

Anyone who has spent any time on social media could tell you that this is more of a 'feelings' topic than a 'facts' topic.

[-] XLE@piefed.social 5 points 3 days ago

Yes, because AI boosters don't themselves deal in facts. It's a religiosity.

If you want statistics about how AI only is losing companies money, or how the finances don't add up, there are articles for that too.

[-] Feyd@programming.dev 15 points 3 days ago

I can’t name any specific people because they include personal friends

From the quote at the top. I keep seeing permutations of this and all I can say is these people are cowards

[-] eestileib@sh.itjust.works 15 points 3 days ago

I have an ex lover that I am still very fond of who is experiencing AI mania as part of their job.

How would it help anyone for me to call them out by name publicly?

[-] Feyd@programming.dev 8 points 3 days ago

The quote is from the founder of hashicorp and is fairly influential. Choosing to let his also influential friends ruin people's lives instead of publicly speaking the truth makes him an asshole. Chances are you and your ex-lover are not influential so I don't give a fuck what you do.

[-] eestileib@sh.itjust.works 12 points 3 days ago

You are 100% correct that I am a fucking nobody, which is a given since I'm posting on Lemmy.

[-] Lemming6969@lemmy.world 0 points 3 days ago
[-] eestileib@sh.itjust.works 2 points 3 days ago

It's not like it would be news to anybody who follows their professional accounts.

[-] sem@piefed.blahaj.zone 1 points 2 days ago

Wow insane world

this post was submitted on 18 Jul 2026
188 points (98.0% liked)

Technology

86512 readers
3176 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS