[-] mrmanager@lemmy.today 80 points 2 days ago

They pass dystopian chat control with one hand and does this with the other.

[-] mrmanager@lemmy.today 22 points 2 days ago* (last edited 2 days ago)

My arch system is so stable it's boring. Year after year, just runs. Doesn't slow down, doesn't install crapware.

So I dont know. I'm happy with it.

[-] mrmanager@lemmy.today 3 points 3 days ago

Also, while improving server performance and failure modes under load would help, the “badly-written, aggressive scraper bots that ignore robots.txt and are given loads of network resources clobbering servers” is something that affects many, many different Web servers out there. This isn’t a Lemmy problem, nor even just social media problem. It’s a Web problem.

100%. Everyone gets this problem and then they put their site behind cloudflare. But what happens when the entire Internet is behind an american company who can decide which sites it likes and which it doesnt?

Same thing for the Threadiverse. The Threadiverse will let you set up a Threadiverse instance and subscribe to everything, efficiently feed all the posts and comments you want to your instance, the moment they come in. In nice, machine-readable form, rather than in something intended for humans that you have to scrape and post-process. But…it takes more dev effort to set up something specific to the Threadiverse than to just treat it like another website.

Yeah, the web was intended to be this universal format that would always work on any platform and any operating system. But the downside is clear today. Some estimates say that we already have much more bot activity than human activity on the internet. And we have AI creating content for the last few years...

[-] mrmanager@lemmy.today 3 points 3 days ago

I totally agree with you actually. Maybe there will be some better solution going forward.

[-] mrmanager@lemmy.today 3 points 3 days ago

@tal@lemmy.today @PapaSkwat@lemmy.today This should be fixed now. It was caused by incorrect caching of the posts. :)

[-] mrmanager@lemmy.today 2 points 3 days ago

Absolutely. :)

[-] mrmanager@lemmy.today 3 points 3 days ago

Hi,

I could actually reproduce this myself now:

https://lemmy.today/post/57605044

This link only works sometimes for me too. I have no idea why so will dig into the server logs. :)

[-] mrmanager@lemmy.today 7 points 3 days ago

I could but there are so many requests, like 30-50 per second, and even if I could cache the login page, I would still spend the bandwidth to send it back to each of those bots. So because of that, and because its not even the main lemmy.today site, I figured its OK to just return 403.

Server load has decreased to almost nothing on old.lemmy.today. During the years we have been online, more and more bots are scraping and now its just ridicolous. :)

24
submitted 3 days ago* (last edited 3 days ago) by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

Hi guys,

Im doing some saturday testing for old.lemmy.today again.

Currently login is required for old.lemmy.today to read posts there. If you are already logged in, you wont notice any difference.

The reason im experimenting is because bots are hammering it, and I wanted to get some statistics of load if I simply dont allow anonymous scraping. Some bots are passing Anubis and scraping content.

So just log in if you havent and it will work just as before.

Thank you!

[-] mrmanager@lemmy.today 2 points 4 days ago

It's fine to not give an email address. It's just for the email to let you know that you were approved or denied. So if you put something random there and check if you can login later, it's all good.

I think it's even optional to give it... You can try registering without. :)

[-] mrmanager@lemmy.today 10 points 5 days ago
[-] mrmanager@lemmy.today 7 points 5 days ago

Yeah the API should be exempt. Will look into this a bit more in the coming days but wanted to see how well Anubis works on old.lemmy.today first for a while. We probably end up using it on lemmy.today as well. Just didnt want to make a big bang change everywhere on day 1. :)

[-] mrmanager@lemmy.today 5 points 5 days ago* (last edited 5 days ago)

It sits between your web browser and old.lemmy.today and detects if you are a bot. If you are, your request doesn't pass through Anubis. It's Gandalf saying "you shall not pass".

So it will hopefully cut down on bots scraping the instance. Or it will piss them off even more. :)

40

Hi guys,

We are now trying out Anubis in front of https://old.lemmy.today/ to see if we can block many of the bots scraping lemmy content.

You will notice an image saying Anubis is checking if you are a bot, and then things should work normally after that.

There are many millions of ips trying to scrape lemmy content so blocking on ip level is difficult. Hopefully this improves the situation somewhat. :)

Thanks to @db0@lemmy.dbzer0.com for sharing info about Anubis!

66
submitted 1 week ago* (last edited 6 days ago) by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

Hi,

We had a DDOS attack against old.lemmy.today which overloaded the entire server for about 20 minutes. I had to turn off old.lemmy.today temporarily and will look through logs and probably block more chinese ip ranges, since thats where it came from.

Always something to do. :) Keeping this as sticky for a while to inform everyone.

Edit: I added more ip blocks for Chinese networks and hopefully it will keep future bots away. Bringing up the old.lemmy.today user interface again...

Edit 2: Had to take it down again due to massive bot scraping. Currently down.

77
Disk maintenance (lemmy.today)

Hi guys,

There is some disk maintenance taking place for the next few days at our hosting provider Hetzner, and they say disk performance could be less than normal but remain operational.

It will affect our images only if it affects anything at all. So if you notice slow images, its temporary for the coming two days only. Probably we dont notice it but wanted to give a heads up. :)

Thank you!

34
Another theme update (thelemmy.club)
submitted 4 months ago* (last edited 4 months ago) by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

Hi everyone!

Main theme updated today

The original cyberpunkish theme has been updated quite a lot today. A lot of things were not properly themed in the old version and the code was just hacked together. Im not a web designer so im learning while I go.

New version is rewritten from scratch and attempts to properly theme the entire Lemmy user interface. Its also using variables everywhere for how things look and feel.

Future plans

  1. Make a light version of this theme.
  2. Share with the lemmy community so it can be used on other instances. Upvote the post if you would like this theme as a choice on your instance.

Huge thanks to Allero

Ive been getting so much feedback on this theme during development from @Allero@lemmy.today, and he (or she) has managed to find lots of things that didnt look quite right. The theme is so much better now because of this help. Super grateful to have had a partner in crime on this one. :)

Important / How to update

In the web browser, you should refresh the theme. Hold shift, hit the reload button, and you should see the new version pop up.

So whats changed?

Quite a lot actually. Almost everything has been tuned to some degree.

  • Added a top bar to complete the look. We use rounded shapes here and in the navigation menus, as an intentional contrast to the more square look of the elements below it.

  • The editor and post view has been restyled with proper support for images, headlines and other things. The sidebar also improved.

  • Comment indent lines changed a bit to be more in the background.

  • Comments are styling code blocks, images, markdown and other things.

  • Post cards got their rails tuned down a bit, and the upvote and downvote arrows follow the theme colors. There is no underline on the card links anymore, for a cleaner look and feel.

  • Tables got a bit of cyberpunk feel to them

  • Settings changed its look as well

  • Listboxes are themed just like everything else

  • And dropdown menus

And lots more small details everywhere.

If you see something that is not themed or not looking correct, please let me know and it will be fixed. :)

22

Hi guys,

One interesting aspect of Lemmy being federated is that there are a lot of broken servers out there who constantly fails to federate. It can be anything that speaks activitypub really, and some of those servers are not properly federating, causing a super long queue of messages not being sent or received.

Ive been adding the most broken ones to our block list so we dont spend resources trying to talk to them. We are still federating with all activitypub servers that behave normally, so this is not about blocking instances that we dont like. This is about blocking broken ones only.

Just wanted to make a post about it so you guys know, in case you see that our instance is blocking instances now. Yes, we do, but only instances that dont federate properly. Otherwise we will continue trying to talk to them forever, wasting resources.

Thats it, just some info. Have a good week!

29
submitted 5 months ago* (last edited 5 months ago) by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

Hi everyone,

Tomorrow our hosting provider Hetzner needs to do an upgrade of their network components, and this affects the network disk we have pictures on.

We will therefore turn off the instance during this time. If you live in Orlando, you will probably be sleeping anyway, but europeans may notice how their memes refuse to load during this time. But we will be back as soon as Hetzner finishes the maintenance. Could be earlier than expected too. We will see.

Edit after downtime: Maintenance seems to have went well, server is up. :)

52
Default theme change (thelemmy.club)
submitted 5 months ago* (last edited 5 months ago) by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

Hi guys,

So I decided to change the default theme to cyberpunkish.css to make this instance look different from a default lemmy instance.

If a lot of people tell me this is a shitty idea and I should not do this, I will revert it. Just wanted to give this instance a style of its own. The default theme is still there under lemmy_default.css if you prefer it.

Let me know if you have strong feelings about it, one way or the other!

40
Feeling cyberpunk? (lemmy.today)
submitted 5 months ago* (last edited 5 months ago) by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

Hi everyone!

There is a new theme called cyberpunkish in the web interface settings now.

I wanted to create a theme for this instance and this is my first stab at it. If you try it out, any feedback is very welcome!

I edited this post to show how it looks now in latest version. I will sticky this post for a day so regular users dont miss info about it.

Frontpage:

Comments:

Communities:

Huge thanks to @Allero@lemmy.today for so much great feedback about the theme.

If many people think its great, perhaps we set it as default for the instance.

117

Hi guys,

The server just got upgraded to double the memory and cores. We had some peak periods where 8 GB was not enough to run everything, and now we get 8 more cores as well to serve more memes faster. :)

Plenty of room for more users too, if they should decide to join.

Thanks for picking this instance, guys. Enjoy Lemmy!

10

The attackers found another slow db query to exploit, so had to put some temporary measures in place.

Will post more details later!

This time they actually took down the instance for several hours.

15
Opinions wanted! (lemmy.today)

Hi guys,

I wanted to ask you about our local communities here. I feel like a lot of them are not really active, and the most active one (like Conservative) has mostly locked posts, so people cant participate in discussions.

I wanted to get some input from you guys, what do you think? Should we have communities with locked posts so people cant comment? Does it still serve a purpose? Or should communities always allow discussions? My own opinion is that they should.

And should we clean up communities and remove inactive ones, making more room for local discussions?

The reason I started thinking about this is because I noticed that some other instances remove posts that are completely legal to discuss. They are just removed because admins/moderators dont like their content. Which is exactly like on reddit then.

view more: next ›

mrmanager

0 post score
0 comment score
joined 3 years ago
MODERATOR OF