this post was submitted on 07 Mar 2025
1230 points (98.3% liked)

Fediverse

31086 readers
654 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to [email protected]!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

founded 2 years ago
MODERATORS
 

I apologize if this is old news, but I just noticed it. It looks like Kagi has added Fediverse Forums as a default Web search option.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 2 days ago (1 children)

Running an index is quite a massive endeavor at the scale of Google. They're a small team.

I think it makes sense considering there's a competitive market of indexes already. They make small ones to cover some niches and use existing ones for the rest.

Keep in mind they also add their own reranking and stuff on top of Bing Google whatever

[–] [email protected] 3 points 2 days ago (1 children)

If they were a small or free service I wouldn't have much issue, but they do charge, I don't think it's too much to ask that they at least attempt to scrape the wider web.

Building their own database seems the prudent thing long-term, I don't doubt they could shore up coverage over Bing. They don't have to replace the other indexes wholesale, just supplement it.

[–] [email protected] 1 points 2 days ago

Why would they do what Google etc. do, but much worse? It makes sense that they do scrape what google etc. most likely miss (and that's what their index is about). Even a company with Microsoft resources tried and failed to scrape the web as a whole (failed in the sense results are worse).