240
submitted 2 days ago by [email protected] to c/[email protected]
you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] 34 points 2 days ago

I work in a field that is mostly related to law and accounting... My biggest fear is to be replaced by a person who pretends that the AI’s output is smart

Aaaaaah. I know this person. They're an accountant. They recently learned about AI. They're starting to use it more at work. They're not technical. I told them about hallucinations. They said the AI rarely wrong. When he's not 100% convinced, he says he asks the AI to cite the source.... 🤦 I told him it can hallucinate the source! ... And then we went back to "it's rarely wrong though."

[-] [email protected] 2 points 3 hours ago

My sister does this. She apparently uses ChatGPT to write small code she uses for output on her company's website. Since I left the IT field she lords over me that I "don't know how good it is cause I don't have the need to use it for work". I just roll my eyes and am waiting for the day when her GPT code ends up failing and crashing the corporate site.

So glad I'm not in IT anymore to tell the truth. Cause it's looking more and more like an AI driven shitshow every day.

[-] [email protected] 24 points 2 days ago

And then we went back to “it’s rarely wrong though.”

I am often wondering whether the people who claim that LLMs are "rarely wrong" have access to an entirely different chatbot somehow. The chatbots I tried were rarely ever correct about anything except the most basic questions (to which the answers could be found everywhere on the internet).

I'm not a programmer myself, but for some reason, I got the chatbot to fail even in that area. I took a perfectly fine JSON file, removed one semicolon on purpose and then asked the chatbot to fix it. The chatbot came up with a number of things that were supposedly "wrong" with it. Not one word about the missing semicolon, though.

I wonder how many people either never ask the chatbots any tricky questions (with verifiable answers) or, alternatively, never bother to verify the chatbots' output at all.

[-] [email protected] 20 points 2 days ago

AI fans are people who literally cannot tell good from bad. They cannot see the defects that are obvious to everyone else. They do not believe there is such a thing as quality, they think it's a scam. When you claim you can tell good from bad, they think you're lying.

[-] [email protected] 8 points 1 day ago
  • They string words together based on the probability of one word following another.
  • They are heavily promoted by people that don't know what they're doing.
  • They're wrong 70% of the time but promote everything they say as truth.
  • Average people have a hard time telling when they're wrong.

In other words, AIs are BS automated BS artists... being promoted breathlessly by BS artists.

[-] [email protected] 6 points 1 day ago

They're also very gleeful about finally having one upped the experts with one weird trick.

Up until AI they were the people who were inept and late at adopting new technology, and now they get to feel that they're ahead (because this time the new half-assed technology was pushed onto them and they didn't figure out they needed to opt out).

[-] [email protected] 5 points 1 day ago

Up until AI they were the people who were inept and late at adopting new technology, and now they get to feel that they’re ahead

Exactly. It is also a new technology that requires far fewer skills to use than previous new technologies. The skills are needed to critically scrutinize the output - which in this case leads to less lazy people being more reluctant to accept the technology.

On top of this, AI fans are being talked into believing that their prompting as such is a special “skill”.

[-] [email protected] 6 points 1 day ago

That's why I find the narrative that we should resist working with LLMs because we would then train them and enable them to replace us problematic. That would require LLMs to be capable of doing so. I don't believe in this (except in very limited domains such as professional spam). This type of AI is problematic because its abilities are completely oversold (and because it robs us of our time, wastes a lot of power and pollutes the entire internet with slop), not because it is "smart" in any meaningful way.

[-] [email protected] 3 points 1 day ago

but that's how it was marketed as to people that buy it. doesn't matter that it doesn't work

[-] [email protected] 4 points 1 day ago* (last edited 1 day ago)

This has become a thought-terminating cliché all on its own: "They are only criticizing it because it is so much smarter than they are and they are afraid of getting replaced."

[-] [email protected] 15 points 2 days ago

never bother to verify the chatbots’ output at all

I feel like this is happening.

When you're an expert in the subject matter, it's easier to notice when the AI is wrong. But if you're not an expert, it's more likely that everything will just sound legit. Or you won't be able to verify it yourself.

[-] [email protected] 12 points 2 days ago

But if you’re not an expert, it’s more likely that everything will just sound legit.

Oh, absolutely! In my field, the answers made up by an LLM might sound even more legit than the accurate and well-researched ones written by humans. In legal matters, clumsy language is often the result of facts being complex and not wanting to make any mistakes. It is much easier to come up with elegant-sounding answers when they don't have to be true, and that is what LLMs are generally good at.

[-] [email protected] 5 points 1 day ago

It's got what plants crave, so I'm told

[-] [email protected] 1 points 1 day ago

I'm of two minds about AI, as I can have the AI find a flaw in my payload object that was causing problems in an edge case that I've only run into on 1/10 customers on a new product we're deploying. But I also have days like last week when it said that the expiration date of 5/27 was only days away until I asked it what the 5th month of the year was.....

AI is at best an idiot savant that's also a habitual liar.

this post was submitted on 30 Jun 2025
240 points (100.0% liked)

TechTakes

2016 readers
139 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS