realitaetsverlust comments on Linux traffic has grown 22.4% in PH this year

[–] realitaetsverlust@piefed.zip 80 points 9 months ago (4 children)

I would expect AI scrapers to fake a windows user-agent tbh.

parent

[–] Whelks_chance@lemmy.world 4 points 9 months ago (3 children)

Why? Isn't it likely that it'll just report e.g. "python-requests" for the user agent, and it's up to the server side to decide what that means?

parent

[–] realitaetsverlust@piefed.zip 10 points 9 months ago

That user agent would make them easily identifiable and therefore blockable. It's more likely that they are trying to hide as a legitimate user.

parent

[–] olafurp@lemmy.world 3 points 9 months ago

That will be labeled as "other" in those cases

parent

[–] maj@piefed.social 2 points 9 months ago

Just hard to believe 6%. That's a huge number. Hopefully it's true🤞

parent