all 15 comments

sorted by: hot top controversial new old
[–] 13 points 5 months ago (6 children)

Hmm. Using the search term "small website discoverability crisis" . . .

On duckduckgo: original website is the third result (after what looks like a SEO firm's longform ad and ycombinator) without quotes and the first result with.

On startpage: original is the first result even without quotes

On mojeek: original is the first result even without quotes

I do not have accounts with any of these search engines and do not allow them to run Javascript or set cookies, although it's possible that duckduckgo may have noticed that someone with my ip often makes highly specific searches and looks at the long-tail results.

My conclusion from that, combined with other people's searches surfacing large sites first, is that the results you receive can be significantly distorted by the search engine's algorithm. Google in particular is likely trying to direct traffic to its advertising customers and should be avoided for that reason.

  • source
  • hideshow 6 child comments
  • [–] [S] 6 points 4 months ago* (last edited 4 months ago) (1 child)

    Hmm. Using the search term “small website discoverability crisis” . . .

    Well, do you think that it's realistic that the average user types that into the search engine's website ? When you already know the exact title of the post on that website, you probable already know the full URL and don't need a search engine. So, that has nothing to do with "discovering" in my opinion, which the blog post is about.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 4 months ago (2 children)

    First result on mojeek! Sounds like discovery of the site is great then

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 5 months ago (2 children)

    If I want you to see my webpages I'll send you links or post them someplace relevant. That doesn't completely stop sloperators and other scrapers but it at least slows them down. The more private pages are password protected or whatnot.

  • source
  • hideshow 2 child comments
  • [–] 2 points 4 months ago (1 child)

    password protection means you'll have 0 visitors. it's better to do proof-of-work instead. which means, the visitor's computer solves some cryptographic puzzle to prove that it has spent energy and therefore money to visit the website. that makes scraping millions or billions of websites practically too expensive to do, while if you only visit a single website, it's still reasonably cheap to do.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -2 points 5 months ago* (last edited 4 months ago) (4 children)