old.lemmy.today is now behind Anubis for bot protection (lemmy.today)

submitted 18 hours ago by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

18 comments fedilink hide all child comments

Hi guys,

We are now trying out Anubis in front of https://old.lemmy.today/ to see if we can block many of the bots scraping lemmy content.

You will notice an image saying Anubis is checking if you are a bot, and then things should work normally after that.

There are many millions of ips trying to scrape lemmy content so blocking on ip level is difficult. Hopefully this improves the situation somewhat. :)

Thanks to @db0@lemmy.dbzer0.com for sharing info about Anubis!

you are viewing a single comment's thread
view the rest of the comments

[-] Allero@lemmy.today 6 points 16 hours ago

Wonder what it means for Lemmy clients if this practice will be expanded to the main URL.

Will mobile apps support it? Or is only old.lemmy.today planned to be protected?

[-] mschae@discuss.mschae23.de 5 points 16 hours ago

Pretty sure the API should be exempt, as well as user agents that don't impersonate browsers. So that should be fine, the only problem is that you need JavaScript to get through the challenge when using a browser (which is a bit unfortunate, as old.lemmy.today doesn't otherwise require JS).

[-] mrmanager@lemmy.today 6 points 15 hours ago

Yeah the API should be exempt. Will look into this a bit more in the coming days but wanted to see how well Anubis works on old.lemmy.today first for a while. We probably end up using it on lemmy.today as well. Just didnt want to make a big bang change everywhere on day 1. :)

[-] Allero@lemmy.today 3 points 15 hours ago* (last edited 15 hours ago)

All good then! :)

[-] Allero@lemmy.today 2 points 15 hours ago

Yeah, the Javascript requirement can be a pain point, even if it affects a small minority of users. Thanks for clarificaton!

[-] 1984@lemmy.today 2 points 15 hours ago

It's not great but I guess it's required. Maybe just required for the initial check and then it can be turned off? Didn't try...

[-] Allero@lemmy.today 4 points 14 hours ago

Tried it, yes it works this way.

this post was submitted on 30 Jul 2026

38 points (100.0% liked)

LemmyToday

318 readers

52 users here now

If you experience issues or problems with this instance (lemmy.today), this is the place to discuss them. Or if you just want to ask questions about how something works. Anything related to the instance or lemmy itself.

founded 2 years ago

MODERATORS

mrmanager@lemmy.today