I would argue that Raine being deluded into believing he was conversing with a thinking being that supported his decision was a rather major contributor to his death, and your claims here continue to perpetuate that misinformation. The government regulating "AI" more could indeed be helpful, but even if it somehow was actually fully sapient, no one in power would give a shit. These companies would continue to use it to exploit as much money as they can from society either way, and the government would let them, so I completely fail to see how pretending LLMs can think helps with that.

My "side" is that LLMs are neat and have some limited utility, but everyone needs to understand (and the companies shilling them should be forced to be honest about) the fact that their output really is just a bullshit guess of words that only has a decent probability of forming a coherent pattern. Easy access to LLMs by misinformed people can be dangerous, in the same way that leaving knives laying around can be dangerous to people who don't understand that they are sharp. The tool itself isn't to blame, but the people who left them lying around without proper precautions certainly around are. The knife is not being abused and has no opinion on the matter.

I suspect I'm not going to convince you of anything. You sound fully committed to anthropomorphizing LLMs. I'm replying anyway, mostly in the hope that it helps other people understand what LLMs actually are before they trust the words spit out by these contraptions.