this post was submitted on 27 Jan 2024
984 points (96.2% liked)

Lemmy.World Announcements

29022 readers
5 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news 🐘

Outages πŸ”₯

https://status.lemmy.world

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to [email protected] e-mail.

Report contact

Donations πŸ’—

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Ko-Fi (Donate)

Bunq (Donate)

Open Collective backers and sponsors

Patreon

Join the team

founded 1 year ago
MODERATORS
984
submitted 9 months ago* (last edited 9 months ago) by [email protected] to c/[email protected]
 

Version 0.19.X Deployment

Hello world!

I'm sure many of you fine folks have been wondering why we have not upgraded to version 0.19.X yet.

The whole team here has been getting asked this question quite a bit, from both members of the community and other instance admins. We want everyone to know, YES, we will upgrade to version 0.19.

We do not have a hard date set for when we will be upgrading as of yet, as we have about 7 associated task items that go along with this upgrade for things we need to double-check and confirm there will be no breakage.

Another big reason why we have not upgraded is due to reports from other instance admins that the front-end GUI can have performance issues. While a large portion of folks access our site using apps on their phones, we would rather not degrade the user experience for the rest of everyone else.

Worst case in terms of UI slowness, we would ask everyone to use either Alexandrite () or Photon () to mitigate the potential performance issues.

One final point to mention to address the delay is that we usually wait 1-2 weeks after a new release before applying it to production. This was complicated by the fact that there were multiple releases right after each other, with each new release having issues we hoped would be patched in the NEXT version. A new version would come up, and we would have to evaluate the stability and performance of it, which would take about 2 weeks, and then ANOTHER version would come out, which we would need to test. This was further complicated by the fact this was during the holiday season.

Version Release Date
0.19.0 2023-12-15
0.19.1 2023-12-20
0.19.2 2024-01-10
0.19.3 2024-01-24

For us, stability is paramount, as we care very much about keeping everyone happy here.

While we can appreciate the rapid release of patches on 0.19, I hope everyone can now understand the delay. If all goes well, we will set a release day in the next week or two, most likely on a Saturday around 1800 UTC.

-jelloeater85

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 196 points 9 months ago (1 children)

I just love how professional the Lemmy instances have become. They went from having stability issues to being extremely stable. I love our Lemmy community.

Keep up the good work!

[–] [email protected] 41 points 9 months ago (1 children)

I just love how professional the Lemmy instances have become.

Too bad upstream Lemmy development didn't adapt. The early 0.19 releases left several big instances hanging with severe bugs leaving them practically unusable.

[–] [email protected] 75 points 9 months ago* (last edited 9 months ago) (1 children)

In the developers defense, there are some bugs that don't appear until a a certain workload threshold is crossed. It's entirely possible for code to pass all tests and yet break when under heavy load in the real world (which can be difficult to simulate).

[–] [email protected] 14 points 9 months ago (1 children)

Yeah many bugs are difficult to catch, but the federation and timestamp issue, was something different and almost like a joke that got out of hand.

[–] [email protected] 12 points 9 months ago (4 children)

the federation and timestamp issue, was something different and almost like a joke that got out of hand.

YOLO-driven development

load more comments (4 replies)
[–] [email protected] 103 points 9 months ago

Thank you for all your hard work!

[–] [email protected] 87 points 9 months ago (1 children)

Thanks for all this info, I knew running the largest Lemmy instance would be challenging in term of version upgrade, and I'm happy you keep us posted on all your plans! Keep up the good work!

[–] [email protected] 57 points 9 months ago* (last edited 9 months ago) (1 children)

Yeah, I think the transparency and inclusivity of this instance serves as a model. I love knowing that places like this can exist.

[–] [email protected] 29 points 9 months ago (1 children)
[–] [email protected] 9 points 9 months ago (1 children)

You're welcome, and thank you too! 😊

load more comments (1 replies)
[–] [email protected] 76 points 9 months ago (2 children)
[–] [email protected] 22 points 9 months ago (3 children)

Literally what we as admins feel like.

load more comments (3 replies)
[–] [email protected] 64 points 9 months ago* (last edited 9 months ago) (2 children)

Speaking as someone who is on an instance (lemmy.today) that ran into a bunch of breakage from the 0.19.X releases, and which still isn't fully resolved, and where the instance admin said that he wished that he could downgrade to 0.18.X but couldn't due to schema changes, I strongly endorse a conservative approach. The releases have not really met the bar that one might want for stability.

That's especially true for lemmy.world, since it hosts a large chunk of the Fediverse communities, and if it has serious problems, there are gonna be spillover effects even on users elsewhere. I'd wait until less-critical instances have been the guinea pig for a bit on releases.

[–] [email protected] 14 points 9 months ago

Seriously. Less is more.

There's no need to keep up with the meme of releasing updates as quickly as possible.

[–] [email protected] 8 points 9 months ago

Well said. I will happily forgo some new features for a while if it means that the overall experience is more consistent.

[–] [email protected] 48 points 9 months ago (1 children)

I've talked a lot of shit about the whole fediverse before, but I appreciate your stance towards stability. It's what users crave! Thank you!

[–] [email protected] 15 points 9 months ago

Leave the Gatorade for the plants...

[–] [email protected] 47 points 9 months ago (5 children)

Thanks for the update. I am looking forward to instance blocking!

load more comments (5 replies)
[–] [email protected] 39 points 9 months ago (4 children)

Good luck with the update! One great thing about 0.19 is that it allows users to check federation status between instances, will be awesome to get that for lemmy.world as well.

[–] [email protected] 19 points 9 months ago

And one thing bad is that logged in users are logged out and can't log back in, getting errors when loggin in or worse, the site showing them a server error and they think the site is down! All fixed by clearing cookies. Or in apps, logging out then back in.

It looks like 0.19.3 may have a fix for this, which is great. IMO it's good that the largest lemmy instance hasn't updated to 0.19 yet, because a bunch of users may have disappeared thinking the site was dead. And you'd never know, because 0.19 counts active users in a different way.

Hopefully this is the one, though!

load more comments (3 replies)
[–] [email protected] 31 points 9 months ago (1 children)

Slow and steady wins the race

[–] [email protected] 30 points 9 months ago (3 children)

Just so you know, there are some major security issues on 0.18. That’s why programming.dev immediately updated. The later bugs on 0.19 we were easily able to work around, while the security issues are major and should be resolved as soon as you can, as it affects every user.

[–] [email protected] 20 points 9 months ago (2 children)

We already patched it. No worries, we got already a tip for weeks. Sad that it got through the tests of the lemmy devs. Such issues should never go live.

load more comments (2 replies)
load more comments (2 replies)
[–] [email protected] 30 points 9 months ago

No need to rush it if the software is in heavy churn. Just pick a date when the dust settles.

[–] [email protected] 23 points 9 months ago (5 children)

Hey just FYI, I've been experiencing a postgres memory leak issue on my instance since the upgrade to 0.19.2. Theres a GitHub issue open about it (#4406), not sure if it's something that will affect you but probably worth keeping in mind

[–] [email protected] 13 points 9 months ago (1 children)

Hi,

thanks for the tip, we will look into this issue and check if it affects anything on our scale.

load more comments (1 replies)
load more comments (4 replies)
[–] [email protected] 20 points 9 months ago

Thank you for looking out for us mobile/desktop web browser peasants. ❀️

[–] [email protected] 19 points 9 months ago

I for one am thankful for the admins' continued dedication to platform stability.

[–] [email protected] 18 points 9 months ago

no rush. most don't notice minor changes. thanks

[–] [email protected] 16 points 9 months ago* (last edited 9 months ago) (1 children)

Hey ever since the update boost won't show my subscriptions and my post/comment history, I can only browse in all

Is this a known issue that I should bring up with the boost people?

Edit: I logged in to the wrong instance lol

[–] [email protected] 9 points 9 months ago

Edit: I logged in to the wrong instance lol

That'll do it.

[–] [email protected] 16 points 9 months ago

Thanks for the update. I appreciate the transparency and honesty.

No pressure from me, I know all too well about upgrading to the newest version and finding out it has a showstopper bug for the features i was planning to use.

Thankyou for running the server and helping build the community and fediverse.

[–] [email protected] 15 points 9 months ago

Thank you for your hard work. Much appreciated.

[–] [email protected] 14 points 8 months ago

Lebowski.Social has also held back with the 0.19 upgrade. We are monitoring lemmy.world for now and will make our upgrade after that most likely.

[–] [email protected] 13 points 9 months ago

Thanks for the transparency. I'm firmly of the "if it ain't broke, don't fix it" school. Upgrading to 0.19 is important for security, but until it is stable, it is also a risk.

[–] [email protected] 13 points 9 months ago (1 children)

We do not have a hard date set for when we will be upgrading as of yet, as we have about 7 associated task items that go along with this upgrade for things we need to double-check and confirm there will be no breakage.

Are there tickets open for these tasks so we can see what you're waiting for? Genuinely wondering

load more comments (1 replies)
[–] [email protected] 12 points 9 months ago (4 children)

0.19 breaks jerboa and idk if/ when that is getting updated

load more comments (4 replies)
[–] [email protected] 12 points 9 months ago

I for one am glad you take your time. I jumped ship from another instance that upgraded to 0.19 back in december and was almost unusable far into january. It's now on 0.19.3 and while federation seems to work again, it's still quite slow and unstable.

[–] [email protected] 10 points 9 months ago* (last edited 9 months ago) (1 children)

Neat. Good to see constant improvement.

Unrelated: What ever happened to the weekly LW community spotlight? It hasn’t been updated in like a month

[–] [email protected] 10 points 9 months ago (3 children)

The admin that organized that has left the team. I’m the new solo-lead for the community team, and will try to get that started again soon. Any suggestions for communities are more than welcome!

load more comments (3 replies)
[–] [email protected] 10 points 8 months ago (6 children)

If all goes well, we will set a release day in the next week or two, most likely on a Saturday around 1800 UTC.

Any chance we get can get a status update?

load more comments (6 replies)
[–] [email protected] 9 points 9 months ago

Take your time, stability and uptime is most important. Thank you :-)

[–] [email protected] 9 points 9 months ago* (last edited 9 months ago)

So ,if everything goes well the first update will be Saturday 10 februari around 18.00 UTC, and then every two weeks? Bonne Chance!

load more comments
view more: next β€Ί