Free and Open Source Software

17915 readers

69 users here now

If it's free and open source and it's also software, it can be discussed here. Subcommunity of Technology.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]

154

This Guy Has Built an Open Source Search Engine as an Alternative to Google in His Spare Time (www.404media.co)

submitted 8 months ago by [email protected] to c/[email protected]

75 comments fedilink hide all child comments

"I found it very weird that there essentially is no way to browse the web in an open manner. So that's what I am trying to build," the founder of Stract said.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 19 points 8 months ago* (last edited 8 months ago) (2 children)

I found the GitHub for it: https://github.com/StractOrg/stract/tree/main

What I still can't figure out (in my very shallow dive into the repo) is if it's a meta search engine like Searx-ng or if it does its own crawling and builds its own search index.

I run Searx-ng and love it, but I'd be interested in a true self-hosted search (though I'd need to devote a lot of resources to build and run such an index).

Anyone know?

Update: Looks like it crawls and maintains its own index. From the credits/thanks at the bottom of the readme (emphases mine):

The commoncrawl organization for crawling the web and making the dataset readily available. Even though we have our own crawler now, commoncrawl has been a huge help in the early stages of development.

[–] [email protected] 9 points 8 months ago

From the readme, it uses its own index:

Fully independent search index.

Also here's a related discussion: https://github.com/StractOrg/stract/discussions/136

[–] [email protected] 2 points 8 months ago

#YaCy is an open source crawler that you can run and feed Searx with. I recall some searx instances that run their own YaCy. YaCy can also share indexes with other YaCy instances.