this post was submitted on 14 May 2025
92 points (100.0% liked)
TechTakes
1859 readers
268 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's a constant cat and mouse atm. Every week or so, we get another flood of scraping bots, which force us to triangulate which fucking DC IP range we need to start blocking now. If they ever start using residential proxies, we're fucked.
I have a tiny neocities website which gets thousands of views a day, there is no way that anyone is viewing it often enough for that to be organic.
quickly, add some ad revenue :P
From ai vendors. Let them pay you for scraping you lol
at least OpenAI and probably others do currently use commercial residential proxying services, though reputedly only if you make it obvious you’re blocking their scrapers, presumably as an attempt on their end to limit operating costs
They have a botnet on residential devices?
the term of art is "residential proxy" and there's a ton of them
for example: it's the flipside of Bright's free VPN service - through Bright Data they sell people access proxied via some user's connection
And companies like honey that pay you (a pittance) to proxy people's requests to porn sites.
Oh never heard of that. I have blocked their scrapers via agents but I haven't felt residential proxy pain.
@db0 @self Residential Proxy Pain are playing at the Dublin Castle in Camden this Friday, £4 advance, £5 on the door
here’s a mastodon post and linked blog post with some details on what currently sets it off
PS: Looks like that sync issue between our instances is resolved now?
yep, it seems so! I haven’t put the permanent fix for the nodeinfo bug into place yet but it’ll be live as soon as I’m able to give it an appropriate level of testing.
Daym, I should set me up some iocane as well I think