The trick that AI pulls is just that it is really good at appearing competent

Yeah it's almost like the AI is an unthinking machine trying to model what a person would answer to the question (prompt) provided to it.

I'm so goddamn tired of people (not you) acting like an LLM "knows" anything nevermind whether it's right or wrong or could even tell you if it didn't know the answer. It's not like a person that can say, "I don't have that knowledge so I know any answer is likely wrong" the machine is going to give you an answer every time. That answer will never be "idk" it'll be whatever hallucination it's confident enough is right based on the model and training.

I do think there are use cases for it and the technology is cool but the vision being sold and propping up our economy with a venture capitalist circle jerk is so far removed from reality.