Understand: I agree wholeheartedly with the idea of intelligence as an emergent property (or I wouldn't have brought it up), and don't think it impossible to achieve AGI. I do contend that this route, of nothing but token input without true correlative context, is a non-starter for such. Making something better and better at predicting what comes next is not going to suddenly create a jump to application in unrelated fields or grant context. Statistical correlation is insufficient to generate actual meaning, no matter how many times you provide feedback on the inference. It doesn't have any actual connection to anything other than text (or hex codes, or other such tokens). If constant hallucinations (demonstrating the lack of any understanding of context) are insufficient to prove this to you, I suppose there is a fundamental difference in the way you understand how LLMs function.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: