40
How hard is it really to have your own webcrawlers and index? (lemmy.world)
submitted 15 hours ago* by to c/asklemmy@lemmy.world
23 comments fedilink hide all child comments
 

With the frustrations from using the usual search engines growing I've been thinking about this a lot lately.

It seems we've poisoned the well by allowing the proliferation of advertising interests to dominate the web.

Like how hard would it be to make your own non-commercial index?

Only human made sites that aren't related to buying, selling, marketing, etc.

Could that be a federated open-source project?

you are viewing a single comment's thread
view the rest of the comments
[–] 10 points 12 hours ago (1 child)

The internet is great for connecting machines. HTTP(s) could even be used to transfer messages. Blockchain is good for maintaining a historical record. The farther down the chain you go, the harder it becomes to rewrite history. You pay for this feature by requiring everyone to permanently keep the whole shared historical record. Some workarounds for the permanent storage of the whole history exist but that's blockchain in a basic form. The permanent record is a nice feature for things like financial transactions.

Blockchain bros tried to convince us blockchain is great for sharing information in an effort to increase its relevance. You may connect it for that reason. In their defence, blockchain can be used for data transfer, it's just not that great at it.

Blockchain could be used to assert trust, but most problems have equally good or better alternative solutions for that. Very often these use digital signatures and public-private keypairs.

You may want to look at YaCy for a decentralised search engine.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •