134
Why there’s no European Google? (ploum.net)
submitted 4 months ago by to c/technology@lemmy.world
49 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 29 points 4 months ago* (last edited 4 months ago) (2 children)

There is https://openwebsearch.eu/ which might kickstart things a bit and many do not know about, but your point still stands.

Its a eu funded effort to have a open index others could use and build upon. Dashboard and Crawling Status: https://openwebindex.eu/ Experimental Search Engine: https://ourrs.eu/

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 4 months ago

    One other hurdle to note specifically in this time: because of the absolute flood of AI bots that tend to hammer popular sites and ignore robots.txt, many web servers out there have moved to a bot allow list — which means if you’ve got a new properly behaved and reporting index bot, you’ll likely find it gets blocked by default on a LOT of the Internet.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 4 months ago

    Thanks for sharing links to this project.

    I've always been kind of curious, why their wasn't an OSS possibility to "download" chunks of aggregated search content.

    I know that technically it would be a challenge, but forcing crawler after crawler to fetch the exact same content (again and again), is also rather inefficient.

  • permalink
  • fedilink
  • source
  • parent