I'm not a web dev but was chatting with a friend who is, lamenting web 2.0 for pretty much the same reasons as OP. He's like "2.0?!? Where have you been? It's all about web3 and blockchains." Now where was that comfortable old rock I had been hiding under again?

When the www was in its infancy, I thought there needed to be a standardized way to classify content. Something Dewey Decimal System-ish I suppose? But it would need to be easy for casual content providers to use, since the only way it could work would be in at a grass roots, decentralized level where each provider would be responsible for classifying their own content.

Perhaps there could be tools like expert systems that would ask you a number of questions about your data and then link it up appropriately. It could usher in a golden age of library science!

But then everyone went fuck that. Search engines.