this post was submitted on 04 Jul 2023
42 points (93.8% liked)

Fediverse

28295 readers
611 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to [email protected]!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 1 year ago
MODERATORS
 

To support decentralization and spread, should lemmy.world close registration at some point to prevent a performance overload due to too many users? Of course, if registration is disabled, there could be a hint placed somewhere near that from other instances you can interact with content on lemmy.world just like you had registered on it. There could be a link to join-lemmys instance overview.

top 41 comments
sorted by: hot top controversial new old
[–] [email protected] 22 points 1 year ago (2 children)

One of the great things about lemmy.world's insane user count growth is actual live stress testing of Lemmy software. Instead of having an open question of how Lemmy might scale with large instances, there's now real world production systems providing that opportunity.

The technical issues will pass, but the notion that merely spreading out the load will alleviate them is probably just treating the symptom than the cause.

I suppose from my PoV I see this as very much live testing in production and have adjusted my expectations around that instead of anticipating a wholly seamless experience.

[–] [email protected] 7 points 1 year ago (1 children)

Lemmy.world - on the way to being the new reddit

Cheered on by its new users.

[–] [email protected] 3 points 1 year ago

I'm definitely willing to deal with some jank for a while while u/ruud tries to get on top of the quickly expanding userbase.

[–] [email protected] 3 points 1 year ago

We're already seeing the development move forward thanks to it. Today's updates made a huge difference in .world performance.

[–] [email protected] 22 points 1 year ago* (last edited 1 year ago) (5 children)

I think no.

I'm having the same issues with pages not loading as everybody else - but this is a critical moment for Lemmy. A site like this only works if it has a lot of users - the more signups the better.

I understand that new users can sign up for other instances, and still see and interact with lemmy.world content - but I think adding any barrier to entry at all will potentially discourage a huge number of new users. As a rule, new users have no idea how lemmy, federation, instances, etc work - and telling them they can't sign up and to consider another instance will probably end with a lot of them just giving up and sticking to reddit.

The server issues will pass, but stunting our growth at such a critical stage might not. It's bad enough that beehaw defederated at a time like this.

[–] [email protected] 6 points 1 year ago

I agree, I initially focused on Lemmy.world but as I understood the Fedverse better I shifted to a smaller instance. I think we need to let people get into Lemmy, and then people will naturally spread out.

[–] [email protected] 4 points 1 year ago (1 children)

I honestly think during the sign up the registration to a server needs to be randomized to spread the load. That and allow the user counts to be global and not just to your instance and you then have user load balancing.

If we could also migrate our data between servers with a backup server option. When lemmy.world goes down, just switch to a different randomized backup server.

[–] [email protected] 10 points 1 year ago

The danger in randomizing servers is that some smaller servers not only have less than 99% uptime but are also just run by random regular people who couldn't handle the increased load and/or have no desire or ability to keep the servers running long term. It could maybe work if the randomization occurs from within a vetted list.

Account migration is a feature that has been noted for the future and would indeed be very important since it would essentially make the entire network bulletproof. Being able to move instances and/or link accounts across multiple instances would create the necessary redundancy and reduce fears of choosing a smaller instance as home.

[–] [email protected] 2 points 1 year ago (1 children)

What's to stop .world "defederating" and cutting all the new users off completely.

It's an odd platform and one that feels like it could all fall apart to someone completely new to it all.

[–] [email protected] 13 points 1 year ago (1 children)

Well Ruud who runs .world also runs Mastodon.world which is a fairly large mastodon instance, so he is somewhat of a known quantity and has experience running large Fediverse servers. His mastodon server has handled a large population and donations happen through Open Collective for transparency as well. He also runs Calckey.world though that is much smaller.

[–] [email protected] -2 points 1 year ago (1 children)

Do you think spez was good once?

[–] [email protected] 7 points 1 year ago

Not really. Also by your logic you can't trust anyone ever because there is always a risk they turn bad at some point in the future. All we can do is evaluate what we have in front of us at the moment. Current evidence suggests Ruud is trustworthy, committed and capable of running a large Fediverse instance.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

I think Beehaw defederating was a good thing. Their rules are pretty totalitarian. It would have happened eventually anyway, better to do it sooner to effect the least amount of content I get.

[–] [email protected] 1 points 1 year ago

I couldn't get anything to load in my phone browser half the time either and my updoots never register. Then I downloaded the jebora app and when it disconnects from the server it flashes at the bottom so you know when it won't post.

Now I can see everything on the site all the time

[–] [email protected] 15 points 1 year ago* (last edited 1 year ago) (1 children)

I'm in favor of simplifying the signup process with auto-assigning an instance. [Edit: For users coming from https://join-lemmy.org/]

For people who start using the fediverse or lemmy, the concept of federated instances is hard to understand. It also does not matter that much at this part of their journey. How about randomly assigning new users to instances which are open? This could also help with load balancing between instances.

The idea is to make entry as quick and easy as possible. Once users familiarized themselves with content and communities, they can reevaluate their 'decision' which instance they want to make their home. At this point, they have a better idea what this is all about.

Choosing an instance right from the start should still be possible, just not be the default mode. Make it a small link at the bottom 'advanced mode' or whatever, just don't scare or burden newcomers with unecessary complexity.


To answer the question directly: I think each instance can make that decision for themselves, and open or close registration accordingly. Both is fine.

[–] [email protected] 7 points 1 year ago (1 children)

Not all instances are going to be equal in terms of things like stability and uptime. It's going to be unfair and frustrating to users who might randomly end up on a bad instance. It might work if it only chose along the top x instances or something, to ensure a bit of reliability for new users.

[–] [email protected] 1 points 1 year ago

It’s going to be unfair and frustrating to users who might randomly end up on a bad instance.

That's true. On the other hand, we currently entrust this decision to people who know the least.

I think we should weigh the benefits of an uninformed decision against the benefits of making signup easier.

It might work if it only chose along the top x instances or something, to ensure a bit of reliability for new users.

Yes, that sounds like a good idea. Not sure if top x is the right measure, but you're right reliability should be a criterion.

[–] [email protected] 11 points 1 year ago (1 children)

I get the point, but that limits the users' right to select which community they want to join. I feel that is more important than preemptive decentralization of content. Hopefully there is a way to migrate communities from one instance to another. Should an instance get too large that would be a good feature to mitigate risk.

[–] [email protected] 3 points 1 year ago* (last edited 1 year ago)

I'm not a lemmy.world user (so I have no dog in this debate) but I'm gonna disagree. I'm of the opinion that signups for an instance should stay open as long as the admins can afford/handle the growth. I think it's unfair to force the admins to keep it open if they aren't able to handle it which is the crux of what OP is asking.

Besides, it's not like those users cant just federate with all the communities of lemmy.world they want. And I bet there won't be a dearth of choices for decent instances if the demand calls for it. Lemmy.ml closed signups despite being the big instance and lemmy.world emerged as an alternative. So why wouldn't something similar happen if lemmy.world did the same?

[–] [email protected] 3 points 1 year ago

Making it difficult for people to abandon reddit and join lemmy at THIS stage would be a bad idea. I think it has to scale.

Eventually if it successfully catches on and becomes the popular option, maybe. But even then I think I’d prefer a (or several) round-robin type options for joining. I think the server names are too exposed in lemmy to be easily understood by the masses. Like I get it but I’m a 20 year dev. Not a person in my family understands.

[–] [email protected] 2 points 1 year ago (3 children)

Depends on server loads and scaling.

If the engineer(s) and admin(s) running things can handle the costs associated with growth then I think it should stay open. However at a certain point the load on the infrastructure, sysadmins, and cost make that untenable.

It’s not cheap to run this kind of stuff. I know that first hand because of my career running HPC clusters and running them in cloud environments.

I’ve got a pretty solid idea of what this must be costing and I’m really thankful that someone is putting in the thankless labor of love. That’s why I canceled my Reddit premium and started donating to this instance to help with that in some way. The only other way I could help is donating my time & experience. But I think they need money more than engineers lol

The TL;DR is that if we want to keep these things online we need to donate money (and/or time/labor).

[–] [email protected] 2 points 1 year ago

Funilly enough, apparently they have enough server power and the bottleneck is the software. Or so I was told.

[–] [email protected] 1 points 1 year ago

This is the one of the best takes here. It's a delicate balance. Performance, cost, and manageability. Fail in any of these, and it doesn't matter, you'll either lose access to the site or be unable to manage it.

If staffing or money are insufficient, the site should do what's necessary for survival, but only just before that threshold is exceeded. Users are important, but self destruction is not an option.

[–] [email protected] 1 points 1 year ago

Even as a small instance operator, the media storage increases at a pretty steady rate. It's probably going to be a case of months or even years before it starts getting to costing money I will notice. But, still I guess we can by then start to purge very old stuff if we're not a big instance though.

[–] [email protected] 1 points 1 year ago (1 children)

I do think there should be a hard limit to the number of total users in an instance. Otherwise as you said the content will get centralised in a specific instance. But that limit should be much higher than what lemmy.world now has. Also closing new registration at this time would be detrimental to the overall ecosystem. This is just my personal opinion.

[–] [email protected] 0 points 1 year ago (1 children)

Having the user count far exceed what the servers can handle is also detrimental to the ecosystem.

People aren't patient. And the current instability we're seeing will just make people give up on Lemmy after a brief attempt to settle in.

[–] [email protected] 1 points 1 year ago (1 children)

You raise a valid point. But finding new communities is much harder in smaller instances. So there is a chance the user will not find content they are interested in.

[–] [email protected] 1 points 1 year ago (1 children)

Isn't the intent of federation, however, that every instance should have access to every community? So even those small instances be able to access the same communities.

Not seeing something means you've intentionally defederarated them (or maybe they've defederarated you?)

Or a server is dying somewhere.

[–] [email protected] 1 points 1 year ago

They do have access to every community. But it won't show up in the community tab until someone in their instance have already joined that community. Correct me if am wrong.

[–] [email protected] 1 points 1 year ago

nope, that would make the experience way worse with federation not working well with communities. like for example I've made a community over on lemmy.world and it has a couple of members and a few posts in it, but I can't see it from any other lemmy instances I've tried (unless it doesn't work if you're not logged in). you can kinda make kbin see it but to make posts appear you have to search for them and if you search for them before you search for the community, they appear in a random magazine and then when the magazine for that community is created the posts that were put in random stay there and never return... so yeah...

[–] [email protected] 1 points 1 year ago (1 children)

Personally I registered in lemmy.world not knowing any better. I would migrate my account to another instance in a heartbeat if it was possible.

[–] [email protected] 1 points 1 year ago (1 children)

It’s been three days. Do it while you’re fresh. You won’t regret it. Responsiveness is worth losing 3 days of points.

[–] [email protected] 0 points 1 year ago* (last edited 1 year ago) (1 children)

This won't improve responsiveness when interacting with lemmy.world communities though right?

[–] [email protected] 1 points 1 year ago

It will. I have no lag on my accounts that aren’t on overran servers. And I mostly interact with content from overran servers.

My Lemmy.world and Lemmy.ml accounts can barely upvote without delays.

[–] [email protected] 1 points 1 year ago

It makes sense to pause registrations if an instance is actively overloaded, but there’s no reason it can’t keep growing if more hardware is added and the performance issues are resolved.

[–] [email protected] 1 points 1 year ago

Yes. Encourage people to use federation FFS.

[–] [email protected] 1 points 1 year ago

I don't think it's necessarily worth it to close, as others have pointed out it's a great real-world stress test for the software.

I DO think it's very much worth having some info on the signup page to let people know

  • they're welcome to join but the server is currently overloaded and experiencing performance issues

  • they don't need to sign up there to access the content

and of course

  • where to go instead

Then everyone is informed and can make up their own mind instead of blindly signing up and assuming this is just what Lemmy is like.

[–] [email protected] 0 points 1 year ago (1 children)

It’s already laggy and unstable. Maybe more hardware and improved software will help, but it might just be hard for lemmy to grow.

[–] [email protected] 1 points 1 year ago

It’s not hard for Lemmy to grow at all. Use a different server. There’s no upside to being on a crowded server. Join a fast and reliable server. Hit “all.” Done.

Lemmy is designed to grow easily.

[–] [email protected] -1 points 1 year ago

At the early stages no. It is vital we keep it open to get as many people through the door to promote fediverse. Eventually some people will create accounts in other instances.

load more comments
view more: next ›