"But look how convincing [it] sounds!"
.... how did we get to the point where the ai bros are un-ironically telling us, as a selling point, that their shiny toy literally gives false yet convincing-sounding medical diagnoses ?!?!?!
If I were working on Claude and wanted to hype it up, I would not talk about this experiment online or in public. If I were working on Claude and wanted to be responsible towards "the public", I would use this example as a cautionary warning, not to further hype up the tool.
This feels like the slight period at the beginning of the NFT craze when I wasn't yet comfortable dismissing out of hand anyone excited about them, because surely there was a least some useful application that wasn't for scamming people, and surely this many people couldn't all be so deluded about the same idea.