this post was submitted on 27 Jun 2023
6 points (100.0% liked)
Technology
37717 readers
381 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I think one of the big problems is that we, as humans, are very easily fooled by something that can look or sound "alive". ChatGPT gets a lot of hype, but it's primarily coming from a form of textual pareidolia.
It's hard to convince people that ChatGPT has absolutely no idea what it's saying. It's putting words together in a human-enough way that we assume it has to be thinking and it has to know things, but it can't do either. It's not even intended to try to do either. That's not what it's for. It takes the rules of speech and a massive amount of data on which word is most likely to follow which other word, and runs with it. It's a super-advanced version of a cell phone keyboard's automatic word suggestions. Even just asking it to correct the punctuation on a complex sentence is too much to ask (in my experiment on this matter, it gave me incorrect answers 4 times, until I explicitly told it how it was supposed to treat coordinating conjunctions).
And for most uses, that's good enough. Tell it to include a few extra rules, depending on what you're trying to create, and watch it spin out a yarn. But I've had several conversations with ChatGPT, and I've found it incredibly easy to "break", in the sense of making it produce things that sound somewhat less human and significantly less rational. What concerns me about ChatGPT isn't necessarily that it's going to take my job, but that people believe it's a rational, thinking, calculating thing. It may be that some part of us is biologically hard-wired to; it's probably that same part that keeps seeing Jesus on burnt toast.
"Jesus on burnt toast" is probably the most apt comparison I've heard on the matter LOL I like your take. ChatGPT (and AI language models in general) are an excellent tool, but at the end of the day, they're just that - a tool. It's a tool I've already begun implementing in my academics, but keeping its weaknesses in mind. It is QUITE flawed, after all. I feel, like calculators, it'll fall into a good role alleviating tedium from certain tasks, but the shock value it's caused in society hasn't worn off. Now, modern day calculators did actually replace an antiquated job of which the name 'calculator' originated from, but I don't feel ChatGPT is good enough at anything enough to actually replace any specific profession, especially anything that requires more than a basic comprehension in a subject matter. It's ultimately still just word vomit, and needs close supervision. After all, all I see in the news is how people have used ChatGPT and got in serious trouble over faulty generations (such as ChatGPT making up fake court cases for lawyers). I've not seen "ChatGPT found the cure to cancer!" Although I remember seeing one incident where it did actually progress a field some by giving professionals a different way of thinking about how to solve a problem. The flooding of extremely sub-par AI written books flooding the market is reassuring to me that writers aren't going to get replaced anytime soon, even though I feel that profession is most at risk, if any are.