this post was submitted on 06 Sep 2024
863 points (97.4% liked)
Technology
60076 readers
3359 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
First off, are you extrapolating the middle part of the sigmoid thinking it's an exponential. Secondly, https://link.springer.com/content/pdf/10.1007/s11633-017-1093-8.pdf
I've written something vague in another place in this thread which seemed a good enough argument. But I didn't expect that someone is going to link a literal scientific publication in the same very direction. Thank you, sometimes arguing in the Web is not a waste of time.
EDIT: Have finished reading it. Started thinking it was the same argument, in the middle got confused, in the end realized that yes, it's the same argument, but explained well by a smarter person. A very cool article, and fully understandable for a random Lemming at that.
Dismiss at your own peril is my mantra on this. I work primarily in machine vision and the things that people were writing on as impossible or "unique to humans" in the 90s and 2000s ended up falling rapidly, and that generation of opinion pieces are now safely stored in the round bin.
The same was true of agents for games like go and chess and dota. And now the same has been demonstrated to be coming true for languages.
And maybe that paper built in the right caveats about "human intelligence". But that isn't to say human intelligence can't be surpassed by something distinctly inhuman.
The real issue is that previously there wasn't a use case with enough viability to warrant the explosion of interest we've seen like with transformers.
But transformers are like, legit wild. It's bigger than UNETs. It's way bigger than ltsm.
So dismiss at your own peril.
Tell me you haven't read the paper without telling me you haven't read the paper. The paper is about T2 vs. T3 systems, humans are just an example.
Yeah I skimmed a bit. I'm on like 4 hours of in flight sleep after like 24 hours of air ports and flying. If you really want me to address the points of the paper, I can, but I can also tell it doesn't diminish my primary point: dismiss at your own peril.
Oooo I'm scared. Just as much as I was scared of missing out on crypto or the last 10000 hype trains VCs rode into bankruptcy. I'm both too old and too much of an engineer for that BS especially when the answer to a technical argument, a fucking information-theoretical one on top of that, is "Dude, but consider FOMO".
That said, I still wish you all the best in your scientific career in applied statistics. Stuff can be interesting and useful aside from AI BS. If OTOH you're in that career path because AI BS and not a love for the maths... let's just say that vacation doesn't help against burnout. Switch tracks, instead, don't do what you want but what you can.
Or do dive into AGI. But then actually read the paper, and understand why current approaches are nowhere near sufficient. We're not talking about changes in architecture, we're about architectures that change as a function of training and inference, that learn how to learn. Say goodbye to the VC cesspit, get tenure aka a day job, maybe in 50 years there's going to be another sigmoid and you'll have written one of the papers leading up to it because you actually addressed the fucking core problem.
I mean I've been doing this for 20 years and have led teams from 2-3 in size to 40. I've been the lead on systems that have had to undergo legal review at a state level, where the output literally determines policy for almost every home in a state. So you can be as dismissive or enthusiastic as you like. I could truly actually give a shit about ley opinion cus I'm out here doing this, building it, and I see it every day.
For any one with ears to listen, dismiss this current round at your at your own peril.
Perilous, eh. Threatening tales of impeding doom and destruction. Who are you actually trying to convince, here. I doubt it's me I'd be flattered but don't think you care enough.
If Roko's Basilisk is forcing you, blink twice.