Part of me feels like this is because of guardrails because we have idiots fucking imagining that if they just force their LLM chatbots to not curse and to not mention bad things and always be agreeable yes men that the world will be pancakes and roses for everybody.

The rest of me realizes that this is because LLMs do not possess sentience.

They do not understand the words that they are using.

There is no cognition happening behind the curtain.

The sad thing is that even without cognition, they are more knowledgeable than the average person because they've been fed the entirety of human knowledge, and the average person seems to be incapable of understanding that just because you know the words about something doesn't mean you actually understand the thing itself.

Like, I've read more DIY books than most people ever will. I can mentally envision the steps needed to put in a septic tank, for instance. But I've never done it. If you ask me to tell you how long it would take, I would probably say a week. But it could take five weeks. I don't fucking know.

I couldn't even tell you if the damn thing would function until after it had been used for quite a while. I've never done it before. Even though I know the logical steps of digging the hole lining it and stalling the drain field, that doesn't mean shit compared to actual implementation.