Droopy comments on Aggressive AI scrapers are making it kinda suck to run wikis

submitted 3 months ago by Itwasntme223@discuss.online to c/fuck_ai@lemmy.world

you are viewing a single comment's thread
view the rest of the comments

[–] Droopy@programming.dev 10 points 3 months ago (1 child)

Do you have links or tutorials that would help to deal with these issues?

parent

[–] Thorry@feddit.org 15 points 3 months ago

Yes, I use this block list as well as my own additions (mostly IPs of misbehaving bots):

It's specifically for Apache, but that's what I use. There are more of these kinds of lists available.

parent

lemmy:	0.19.20
mlmym (mschae):	26.3.4