Better technology won't make LLM techniques break out of their limitations, we are already throwing massive compute at it for marginal returns.

it's GIGO though. the ONLY way an LLM can improve is if it can consume "healthy food" and currently, and for awhile now, has been gorging on literal human and other LLMs waste. and humans have been willingly providing it a plate of literal shit to feast on.

They need honest and reliable data, they're not getting it and you can be as optimistic as you want but they'll never get it. Unless someone is magically able to change the opinions of 100% of the populace we will continue to feed it shit and watch it poison itself.