215

Now even my personal instance is infested by these AI crawlers (potato-guy.space)

submitted 2 weeks ago* (last edited 2 weeks ago) by [email protected] to c/[email protected]

33 comments fedilink hide all child comments

It's impossible, i got this instance to just see lemmy from my own instance, but no, it was slow as hell the whole week, i got new pods, put postgres on a different pod, pictrs on another, etc.

But it was slow as hell. I didn't know what it was until a few hours before now. 500 GETs in a MINUTE by ClaudeBot and GPTBot, wth is this? why? I blocked the user agents, etc, using a blocking extension on NGINX and now it works.

WHY? So google can say that you should eat glass?

Life is now hell, if before at least someone could upload a website, now even that is painfull.

Sorry for the rant.

you are viewing a single comment's thread
view the rest of the comments

[-] [email protected] 53 points 2 weeks ago

At some point they're going to try to evade detection to continue scraping the web. The cat and mouse game continues except now the "pirates" are big tech.

[-] [email protected] 33 points 2 weeks ago* (last edited 2 weeks ago)

They already do. ("They" meaning AI generally, I don't know about Claude or ChatGPT's bots specifically). There are a number of tools server admins can use to help deal with this.

Fuck AI

3238 readers

1003 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 1 year ago

MODERATORS

[email protected]