[-] nutomic@lemmy.ml 19 points 6 days ago

Working on Lemmy, instead of selling my soul to a company.

58
submitted 1 week ago by nutomic@lemmy.ml to c/fediverse@lemmy.world

join-lemmy.org regularly crawls all active Lemmy instances to keep the instance list updated. Additionally it also collects data from all Lemmy communities. The data is now publicly available in the following git repository:

https://github.com/LemmyNet/lemmy-statistics

Check the readme for details about the available data. Interestingly the numbers are quite different from other websites:

join-lemmy.org fediverse.observer fedidb.com
Monthly Active Users 42.170 36.336 50.063
Instances 512 376 446

Here are some ideas what to do with the data:

  • Recreate the Lemmymap, graphically showing the connections or defederations between instances.
  • Render graphs, which could be added directly to join-lemmy.org (#532).
  • Investigate what is causing the different numbers shown above.
  • Run various types of analysis, like this one done by @malsadev.
  • Build a tool to help users discover interesting and relevant communities.
33
submitted 1 week ago by nutomic@lemmy.ml to c/fediverse@lemmy.ml

join-lemmy.org regularly crawls all active Lemmy instances to keep the instance list updated. Additionally it also collects data from all Lemmy communities. The data is now publicly available in the following git repository:

https://github.com/LemmyNet/lemmy-statistics

See the readme for details about the available data. Interestingly the numbers are quite different from other websites:

join-lemmy.org fediverse.observer fedidb.com
Monthly Active Users 42.170 36.336 50.063
Instances 512 376 446

Here are some ideas what to do with the data:

  • Recreate the Lemmymap, graphically showing the connections or defederations between instances.
  • Render graphs, which could be added directly to join-lemmy.org (#532).
  • Investigate what is causing the different numbers shown above.
  • Run various types of analysis, like this one done by @malsadev.
  • Build a tool to help users discover interesting and relevant communities.
80
submitted 1 week ago* (last edited 1 week ago) by nutomic@lemmy.ml to c/announcements@lemmy.ml

Last month @Nutomic made some posts in !lemmy@lemmy.ml to get feedback and ideas for the official website join-lemmy.org:

Based on these we made various changes to the site. Most importantly, visitors can now register on a suggested Lemmy instance with a single click. Additionally the feature overview, app list, and instance list were reworked.

join-lemmy.org is one of the first search results for people who hear about Lemmy, and want to find out what it is. They should easily be able to register an account to become an active user, with as little friction as possible.

So if you have any suggestions for further improvements, please open an issue or comment below. We especially need help from designers to create better images and polish the design. You can also contribute by translating the site to your language via Weblate.


Now on to the Lemmy code itself. On this front it has been mostly the same as last month: Implementing the new backend features in the UI, bug fixing and minor backend changes. You can follow the progress with these milestones:

If you are impatient to see the new features in production, we share those feelings. But there is still a lot of work needed to make sure the new features work well and make for a good user experience. If you have any experience with web development (or want to learn it), you can also contribute. Checkout the lemmy-ui repo and the milestone above. It is written in standard Typescript with Bootstrap. Additionally you can help by testing the new version on voyager.lemmy.ml and reporting any problems.

Finally here are the major changes from January:

Full list of changes by user

matc-pub

iByteABit256

electricatgit

dankxiaobong

MV-GH

dessalines

Nutomic

Or see the full list of changes at the links below:


An open source project the size of Lemmy needs constant work to manage the project, implement new features and fix bugs. Dessalines and Nutomic work full-time on these tasks and more. As there is no advertising or tracking, all of our work is funded through donations. Even so there is barely enough time in the day, and no time for a second job. The only available option are user donations.

To keep it viable donations need to reach a minimum of 5000€ per month, resulting in a modest salary of 2500€ per developer. If that goal is reached we can stop worrying about money, and fully focus on improving the software for the benefit of all users and instances. We especially rely on recurring donations to secure the long-term development and make Lemmy the best it can be.

Donate

48
submitted 2 weeks ago* (last edited 2 weeks ago) by nutomic@lemmy.ml to c/lemmy@lemmy.ml

join-lemmy.org runs a crawl of all active Lemmy instances every four hours in order to keep the instance list up to date. These statistics are now publicly available in the following git repo:

https://github.com/LemmyNet/lemmy-statistics

As described in the readme there are a few different output files available. From full crawl data with the entire output of /api/v3/site and /api/v3/federated_instances, to minimal data which only includes the number of users, posts etc. You can also access historical stats through the git history. In the future we may also to provide additional data, such as a full list of communities.

So here are some ideas what you could do with this data:

  • Graphs which can be shown directly on join-lemmy.org (#532).
  • Website with detailed filters for instance settings.
  • Map of Lemmy instances, showing who they federate or defederate with (like the discontinued lemmymap)

Interestingly our stats differ significantly from other websites. It would be interesting to analyze and find out what's causing the differences:

join-lemmy.org fediverse.observer fedidb.com
Monthly Active Users 41.615 35.644 49.386
Instances 514 375 449
4
submitted 3 weeks ago by nutomic@lemmy.ml to c/todayilearned@lemmy.ml

Why? Do they think this is a videogame??

69
submitted 4 weeks ago* (last edited 4 weeks ago) by nutomic@lemmy.ml to c/lemmy@lemmy.ml

On join-lemmy.org, the project is described as "A forum and link aggregator for the Fediverse". In the previous post, multiple people mentioned that this is not a good description. However I have a hard time coming up with anything better.

So please post your suggestions below, and upvote the ones which are both accurate and easy to understand for new users. Later I pick one of the most upvoted options for the website.

By the way the second title "Follow communities Anywhere in the world" will likely go away (see the pull request for frontpage redesign). After this is decided I may also make another post to get suggestions for the longer description text below ("Lemmy is a selfhosted social link aggregation and discussion platform. ...").

Edit: Please only post concrete suggestions in top-level comments, and use replies to discuss. And here you can see how a few other Fediverse projects do it:

77
submitted 1 month ago* (last edited 1 month ago) by nutomic@lemmy.ml to c/lemmy@lemmy.ml

When people are told about Lemmy and look for it in a search engine, join-lemmy.org is one of the first pages that comes up. Here they should be able to find out what Lemmy is, and be able to register an account to start posting.

At the moment this still seems too complicated, so I'm looking for your suggestions to improve it:

  • On the main page, is the text relevant and up to date or should anything be changed?
  • How about the instance selection wizard (click "join a server" on the homepage), which lets you select topics and languages to select instances. Do the current options make sense?
  • The instance list itself, is there any information missing, or potential design improvements?
  • And the list of apps, what can be done here? For one thing the data is rarely updated, so we would appreciate pull requests.
  • Any other suggestions you may have.

Since yesterday I already made a couple of improvements:

Edit: Here is a draft for some changes to the frontpage: https://github.com/LemmyNet/joinlemmy-site/pull/524

113
submitted 1 month ago by nutomic@lemmy.ml to c/fediverse@lemmy.ml

See here for examples:

There is still more testing and development needed, check the issue for more details.

47
submitted 1 month ago by nutomic@lemmy.ml to c/announcements@lemmy.ml

Last month saw more cleanup and bug fixes for the development version. We also setup nightly builds which are automatically deployed to voyager.lemmy.ml, as detailled in the 0.19.15 announcement post.

This upcoming month we'll be working on the existing lemmy-ui 1.0 milestone and lemmy 1.0 milestone issues. Our work should be reflected nightly on voyager.lemmy.ml, so we'd much appreciate anyone helping to find bugs and issues

Here are the major changes from December:

Full list of changes by user

flamingos-cant

AcesFullOfKings

matc-pub

dessalines

Nutomic

Or see the full list of changes at the links below:


An open source project the size of Lemmy needs constant work to manage the project, implement new features and fix bugs. Dessalines and Nutomic work full-time on these tasks and more. As there is no advertising or tracking, all of our work is funded through donations. Even so there is barely enough time in the day, and no time for a second job. The only available option are user donations.

To keep it viable donations need to reach a minimum of 5000€ per month, resulting in a modest salary of 2500€ per developer. If that goal is reached we can stop worrying about money, and fully focus on improving the software for the benefit of all users and instances. We especially rely on recurring donations to secure the long-term development and make Lemmy the best it can be.

Donate

110
submitted 1 month ago by nutomic@lemmy.ml to c/announcements@lemmy.ml

What is Lemmy?

Lemmy is a self-hosted social link aggregation and discussion platform. It is completely free and open, and not controlled by any company. This means that there is no advertising, tracking, or secret algorithms. Content is organized into communities, so it is easy to subscribe to topics that you are interested in, and ignore others. Voting is used to bring the most interesting items to the top. Thanks to @flamingos-cant for contributing to resolve this.

Changes

We messed up the previous release and did not include the full list of changes. In fact there were a handful of other bug fixes, and notably a maximum page limit of 10 to prevent a DDoS attack. Some users were also hitting this limit, so with this version the limit is increased to 100. We apologize for these mistakes.

Here is the full changelog since 0.19.13:

  • Don't allow accessing page numbers greater than 10 by @dessalines #6017
  • Update deps based on cargo audit by @Nutomic in #6258
  • Increase page limit to 100 by @Nutomic in #6252
  • Ban federation for deleted users by @Nutomic in #6207
  • Federate mod actions on deleted users by @Nutomic in #6199
  • Allow admins to view deleted user profiles by @Nutomic in #6194
  • Adding creator and community indexes for post_aggregates. by @dessalines in #6025
  • Ignore apub person banners which cannot be parsed by @Nutomic in #6015u

Now for the good news, the development version of Lemmy 1.0 is available for testing on voyager.lemmy.ml with lots of new features. Registration is open, you're welcome to create an account. Feel free to post spam and try everything out. Here is only a short overview:

  • Multi-communities: Combine different communities together into a custom feed.
  • Post scheduling: Specify when your post should be published.
  • Keyword filter: Automatically hide posts about certain topics.
  • Private communities: Only followers can view the content, and need to be approved manually by mods. Other community visibilities are also available (unlisted, local only).
  • New notification system: Including notifications for mod actions, and subscribing to communities and posts to be notified about new comments.
  • OAuth: Login to Lemmy with existing account from another website. Use this link to signup with your Github account (the UI still needs to be improved).
  • Post Tags: Categorize posts within a community (UI part not implemented yet).
  • User vote totals: You can see the total number of upvotes and downvotes given to each user.
  • User notes: You can keep notes on other users.
  • Combined Feeds: View your saved, liked posts and comments together in a single list.
  • Comment Locking: Mods can now lock comments recursively.
  • GDPR style data exporting: You can now export your full posting history as a JSON file.
  • Plugins: Can be written in JS, Python, Rust, and any other language that targets Webassembly. The test server has a plugin for automatic language tagging of posts.
  • Cursor pagination: Don't lose your place in the feed when switching pages.
  • API v3 compat: Lemmy 1.0 can be used by existing apps with no changes (but most new features are only available via the new API v4).
  • More: Countless smaller features, bug fixes and improvements, too much to list here.

All the above mentioned features are already implemented and fully working, but may need some polishing. If you encounter any problems, please open an issue (backend, frontend). voyager.lemmy.ml is automatically updated to the latest development version every night, so that changes can immediately be tested.

Keep in mind that Lemmy 1.0 is still in alpha state. There may be breaking changes and critical bugs, so do not attempt to upgrade your own instances yet. We intend to publish the first beta version in January, along with API docs and upgrade instructions for test servers.

We hope that you are as excited about these new features as we are. With all this said, happy testing and Merry Christmas!

Upgrade instructions

There are no breaking changes with this release.

Follow the upgrade instructions for ansible or docker.

If you need help with the upgrade, you can ask in our support forum or on the Matrix Chat.

Thanks to everyone

We’d like to thank our many contributors and users of Lemmy for coding, translating, testing, donating and reporting bugs. We're glad many people find it useful and enjoyable enough to contribute.

Support development

We (@dessalines and @nutomic) have been working full-time on Lemmy for over five years. This is largely thanks to support from NLnet foundation, as well as donations from individual users.

If you like using Lemmy, and want to make sure that we will always be available to work full time building it, consider donating to support its development. A recurring donation is the best way to ensure that open-source software like Lemmy can stay independent and alive, and helps us grow our little developer co-op to support more full-time developers.

238
submitted 1 month ago by nutomic@lemmy.ml to c/privacy@lemmy.ml
94
Lemmy Release v0.19.14 (join-lemmy.org)
submitted 2 months ago by nutomic@lemmy.ml to c/announcements@lemmy.ml

What is Lemmy?

Lemmy is a self-hosted social link aggregation and discussion platform. It is completely free and open, and not controlled by any company. This means that there is no advertising, tracking, or secret algorithms. Content is organized into communities, so it is easy to subscribe to topics that you are interested in, and ignore others. Voting is used to bring the most interesting items to the top. Thanks to @flamingos-cant for contributing to resolve this.

Changes

Recently some malicious users started to use an exploit where they would post rule violating content and then delete the account. This would prevent admins and mods from viewing the user profile to find other posts, and would also prevent federation of ban actions.

The new release fixes these problems. Thanks to @flamingos-cant for contributing to solve this.

Upgrade instructions

There are no breaking changes with this release.

Follow the upgrade instructions for ansible or docker.

If you need help with the upgrade, you can ask in our support forum or on the Matrix Chat.

Thanks to everyone

We'd like to thank our many contributors and users of Lemmy for coding, translating, testing, and helping find and fix bugs. We're glad many people find it useful and enjoyable enough to contribute.

Support development

We (@dessalines and @nutomic) have been working full-time on Lemmy for over five years. This is largely thanks to support from NLnet foundation, as well as donations from individual users.

If you like using Lemmy, and want to make sure that we will always be available to work full time building it, consider donating to support its development. A recurring donation is the best way to ensure that open-source software like Lemmy can stay independent and alive, and helps us grow our little developer co-op to support more full-time developers.

[-] nutomic@lemmy.ml 112 points 9 months ago* (last edited 9 months ago)

Update: For those of you who want to support Lemmy development without financing the hosting of lemmy.ml, know that the hosting is paid exclusively through OpenCollective. You can see the payment details at this link. This means donations through all other platforms (Liberapay, Ko-fi, Patreon, Crypto) are exclusively for Lemmy development, and not a single cent goes to lemmy.ml hosting.

Edit: Liberapay is the preferable donation option, as it has very low fees and is also open source.

[-] nutomic@lemmy.ml 71 points 1 year ago

I only stopped there for transit on a flight to Mexico. Just before boarding my flight I was told that I need a visa for the US, which is extremely weird because normally airports have transit zones where you don't need any visa. But apparently the US is special, so you actually have to enter the country before going right back into the airport. This nonsense made me miss my flight.

Also I remember in the airport there was a security guard doing nothing but shouting nonstop that it's not allowed to carry water. Why not simply put up a sign?

[-] nutomic@lemmy.ml 112 points 2 years ago

I find it very questionable that you publish this sort of hit piece against Lemmy without even bothering to ask for a comment from our side. This is not how journalism should work.

Effectively you are blowing the complaints of a single user completely out of proportion. It is true that we didnt respond ideally in the mentioned issue, but neither is it okay for a user to act so demanding towards open source developers who provide software for free. You also completely ignore that this is an exception, there are thousands of issues and pull requests in the Lemmy repos which are handled without any problems.

Besides you claim that we dont care about moderation, user safety and tooling which is simply not true. If you look at the 0.19.0 release notes there are numerous features in these areas, such as instance blocking, better reports handling and a new moderator view. However we also have to work on improvements to many other features, and our time is limited.

Finally you act like 4000€ per month is a lot of money, however thats only 2000€ for each of us. We could stop developing Lemmy right now and work for a startup or corporation for three or four times the amount of money. Then we also wouldnt have to deal with this kind of meaningless drama. Is that what you want to achieve with your website?

[-] nutomic@lemmy.ml 211 points 2 years ago

That instance list is built completely automatically by a crawler, no one approves instances before they are listed. In this case it was removed as soon as we became aware of it. Next time please make a pull request like that one, its much more effective than complaining.

[-] nutomic@lemmy.ml 72 points 2 years ago* (last edited 2 years ago)

Wow lots of questions here.

  • Im doing well, its exciting to know that so many people like the software Ive worked on for the last years. The first month after the migration was really stressful, but by now its calmed down a lot. Plus there are many contributors now which are helping a lot.
  • Unfortunately the user donations are just barely enough to pay our salaries, by my calculations the income from Liberapay, Patreon and Open Collective is around 4000 USD per month. Luckily we still have some NLnet funding left, and should be able to work on those milestones now that things have calmed down. I hope the user donations will increase so that they can pay us proper salaries. Maybe even hire additional people, but that seems very optimistic now. It would also be good if we could find other funding sources besides NLnet, as its not clear if they will fund us another year.
  • I think the "breaking bugs" were really minor considering how we had to constantly rush out performance and security fixes. This should get better as we dont need to make emergency fixes, and have more time to let the community test release candidates before making the full release.
  • Supporting downgrades means that someone has to test them and report/fix problems. We dont have time for that, but feel free to do it.
  • Like I said, our recent releases had urgent performance/security fixes so we didnt have enough time for testing. We also didnt find out about these problems until later. Part of the problem is that keeping up with issues is almost a full-time job on its own, so I rarely read them anymore. If you see something important reported, do let me know.
  • No concrete plans, but I definitely think that admins are the main actors who should have a voice in development. Its impossible for us to listen to all the individual users, because there are too many and they often dont have the necessary technical knowledge. If you have some ideas how to facilitate communication between devs and admins, let me know.

Are we almost done? Nope, only halfway. Will answer the second half a bit later.

[-] nutomic@lemmy.ml 87 points 2 years ago* (last edited 2 years ago)

I dont follow /c/worldnews so I dont see much of that. Also hexbear is federating now, so it might easily swing back the other way again.

[-] nutomic@lemmy.ml 75 points 2 years ago

Haha youre a very curious one :D

  1. See https://lemmy.ml/comment/2348893
  2. It sure isnt perfect, partly because Mastodon makes no efforts to be compatible and expects everyone else to cater to their way of doing things. Regardless, the fact that you can interact between different platforms is a huge improvement over current social media platforms. And Im certain that interoperability will only get better over time.
  3. Its already happening, look at Kbin combining the concepts of Reddit and Twitter into one. Or mitra which adds cryptocurrency integrations. There are probably others which Im unaware of.
  4. Sure usability needs to improved, this will happen naturally over time as more users join and suggest improvements.
  5. Its really genius because it combines the best aspect of centralized (simple login with username/password and an admin who manages technical stuff) with those of p2p (no central point of failure). Real p2p is great in theory, but it requires way too much technical knowledge for the average user, so its unlikely to ever gain mass appeal.
  6. Personally I think the Fediverse is really the future of social media, so it will grow whether we want it or not. And its much healthier than the corporate platforms with their tracking, advertising and manipulating algorithms, so the more people leave them behind, the better. I dont see a way to influence this growth, we just need to adapt and deal with it.
  7. Basically my previous reply, I dont know enough about journalism to give a more specific answer.
  8. The biggest and proudest was definitely when tens of thousands of Reddit users suddenly came here, and most of them actually liked it. Cant say there was anything bad or embarrassing, the experience for me is really positive.
  9. It feels great, I never expected this when I started contributing to Lemmy.
[-] nutomic@lemmy.ml 81 points 2 years ago

Account migration is not in the works, and I consider it very low priority. Unlike Mastodon, Lemmy isnt focused on individual users, so it doesnt matter much if you start posting from another instance one day. If its important for you, you can always put a link in your profile to your other accounts. I would rather implement a way to export/import account data. Thats much simpler and can also be used as a backup in case your instance goes down.

[-] nutomic@lemmy.ml 88 points 2 years ago

I definitely didnt expect it, nor did I expect that there would suddenly be more than a dozen different apps. But its not a problem, the more choices users have the better. Those who like such clients can use them, thout it affecting anyone else. Plus monetization of apps could potentially help to fund development of Lemmy itself.

For instances with ads its pretty much the same, more choice for users. But I really doubt that model can have any success considering how many free instances are around which are run by volunteers. Defederation should be unnecessary assuming that ads are only shown to local users.

[-] nutomic@lemmy.ml 100 points 2 years ago

That particular improvement is actually mine. Lemmy was storing a lot of federation data which was completely unused so I removed it. However the 80% improvement is actually overstated, because not all data was migrated to the new table. So the db will grow a bit bigger over time, but still much smaller than before.

Phiresky made a lot of other sql optimizations which make Lemmy snappier and reduce CPU usage on the server. We don't have any benchmarks in that regard, but server load on lemmy.ml has gone down a lot since upgrading.

view more: next ›

nutomic

0 post score
0 comment score
joined 6 years ago
MODERATOR OF