I'm not talking about bolting things together at random. I'm talking about things like mixture of experts or chain of reasoning, which apply structures to coax more rational behavior out of the systems. You do have to generate new bodies of training data for them, but there are ways of doing that algorithmically. This allows them to move away from the strict "regurgitate the Internet" models of the previous versions. There isn't, currently, this kind of structure to drive the systems towards an honest assessment of their own knowledge and limits, but it's basically inevitable that such a system will be developed, because it's a valuable kind of behavior to be able to favor.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments