Special bootlicking points:
Source: xcancel.com
@PITLORDMOSH: weirdly dev-hostile take for a company blog
@tqbf (The author of the blogpost): I tried to post it on my personal blog and Kurt wouldn't let me.
For reference Kurt is the CEO of the company that the author works for: https://archive.md/Z2xvg
Not high on the list of thought crimes, but a particular ick for me:
Also: 100% of all the Bash code you should author ever again
Why the bash hate?
Oh no! I wasted my time on Troll. Typical.
Hard disagree, as much as I loathe JK Rowling's politcal ideas, and the at-times unecessary cruelty found in the HP novels, it still shaped a large part of the imaginary world of a generation. As beautiful as bird songs are (who the hell refers to birdsong as "output"), this simply cannot be compared.
Yes commercial for-profit shareholder-driven lackadaisical "art" is already an insult to life and creativity, but a fully-or-mostly automated slop machine is an infinitely worse one.
Even in the sloppiest of arts I have watched, the humanity still shines through, people still made choice, even subjected to crazy uninispired didacts from above, the hands that fashion books, movies, music, video-games, tv-shows still have—must have—room to bring a given vision together.
I think people DO care.
I don't know exactly what you wanted to say, if you wanted to express despair, cynisism, nihilishm or something else, but I would encourage you not to give up hope with humanity, people aren't that stupid, people aren't that void of meaning.
The standout monuments of stupidity—and/or monstrosity—in McCarthy's response for me are.
Not surprised, still very disappointed, I feel sick.
No no no it's fine! You get the word shuffler to deshuffle the—eloquently—shuffled paragraphs back into nice and tidy bullet points. And I have an idea! You could get an LLM to add metadata to the email to preserve the original bullet points, so the recipient LLM has extra interpolation room to choose to ignore the original list, but keep the—much more correct and eloquent, and with much better emphasis—hallucinated ones.
And also closing with:
Nvidia insists that it “wins on merit, as reflected in our benchmark results and value to customers.” And Nvidia does have the best stuff — but that’s not what the DOJ, Warren, or France are concerned about, is it?
To tie the bow nicely.
Quinn enters the dark and cold forest, crossing the threshold, an omnipresent sense of foreboding permeates the air, before being killed by a grue.
“Once we get AGI, we’ll turn the crank one more time—or two or three more times—and AI systems will become superhuman—vastly superhuman. They will become qualitatively smarter than you or I, much smarter, perhaps similar to how you or I are qualitatively smarter than an elementary schooler. “
Also this doesn't give enough credit to gradeschoolers. I certainly don't think I am much smarter (if at all) than when I was a kid. Don't these people remember being children? Do they think intelligence is limited to speaking fancy, and/or having the tools to solve specific problems? I'm not sure if it's me being the weird one, to me growing up is not about becoming smarter, it's more about gaining perspective, that is vital, but actual intelligence/personhood is a pre-requisite for perspective.
Hi, I'm going to be that OTHER guy:
Thank god not all dictionaries are prescriptivists and simply reflect the natural usage: Cambridge dictionary: Beg the question
On a side rant "begging the question" is a terrible name for this bias, and the very wikipedia page you've been so kind to offer provides the much more transparent "assuming the conclusion".
If you absolutely wanted to translate from the original latin/greek (petitio principii/τὸ ἐν ἀρχῇ αἰτεῖσθαι): "beginning with an ask", where ask = assumption of the premise. [Which happens to also be more transparent]
Just because we've inherited terrible translations does not mean we should seek to perpetuate them though sheer cultural inertia, and much less chastise others when using the much more natural meaning of the words "beg the question". [I have to wonder if begging here is somehow a corruption of "begin" but I can't find sources to back this up, and don't want to waste too much time looking]
I feel mildly better, thanks.
Transcribed:
Max Tegmark (@tegmark):
No, LLM's aren't mere stochastic parrots: Llama-2 contains a detailed model of the world, quite literally! We even discover a "longitude neuron"Wes Gurnee (@wesg52):
Do language models have an internal world model? A sense of time? At multiple spatiotemporal scales?
In a new paper with @tegmark we provide evidence that they do by finding a literal map of the world inside the activations of Llama-2! [image with colorful dots on a map]
With this dastardly deliberate simplification of what it means to have a world model, we've been struck a mortal blow in our skepticism towards LLMs; we have no choice but to convert surely!
(*) Asterisk:
Not an actual literal map, what they really mean to say is that they've trained "linear probes" (it's own mini-model) on the activation layers, for a bunch of inputs, and minimizing loss for latitude and longitude (and/or time, blah blah).
And yes from the activations you can get a fuzzy distribution of lat,long on a map, and yes they've been able to isolated individual "neurons" that seem to correlate in activation with latitude and longitude. (frankly not being able to find one would have been surprising to me, this doesn't mean LLM's aren't just big statistical machines, in this case being trained with data containing literal lat,long tuples for cities in particular)
It's a neat visualization and result but it is sort of comically missing the point
Bonus sneers from @emilymbender:
Ah but not everyone's taste is the same, therefore the best conceible plate of nachos is made worse by existing, because it can then be confronted to people's preferences instead of staying in the platonic realm!