admin

joined 1 year ago
MODERATOR OF
[–] [email protected] 2 points 1 year ago

Thanks, added as a sticky in the lemmit community.

Ideally I want to have this done automatically.

[–] [email protected] 1 points 1 year ago

thank you!

Beside the fact that this community already exists, I think all of the ask-* reddits are terrible contender for being replicated here.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

Cheers, ~~both~~ all three of you. We're off to a beautiful federated future.

[–] [email protected] 5 points 1 year ago (4 children)

Congrats on reaching this set of sane rules. The efforts of creating an admin community behind the scenes are really starting to show off.

Request for clarification for uhmm, a friend of mine: When someone creates that own instance, with blackjack and hookers, and one of your users subscribes to a community there, it will synchronise part of that content to lemmynsfw. What will you do then?

I'd like to remind you that some beautiful maniacs can be quite reasonable ;)

[–] [email protected] 2 points 1 year ago

Yeah, I've upped the limit on this server, so it should come through now if you retry.

[–] [email protected] 1 points 1 year ago (1 children)

you should retry ;)

[–] [email protected] 0 points 1 year ago (1 children)

Sad news: the maximum length for a community name on Lemmy is 20 characters, whereas it's 21 on Reddit. There is a request open on github to extend this limit, but until then, this isn't going to work.

[–] [email protected] 0 points 1 year ago (2 children)

That could work, but it would be terrible for discoverability. In the mean time, I put up a feature request at Lemmy. I'm not a fan of pushing my problems upstream, but in this case it would actually be the easiest solution - as far as I can see (and I have 0 experience with Rust) they only need to adjust the validation regex, because the database already allows for it. That is - as long as the ActivityPub protocol allows for it.

If they deny it, I could try something with name mapping, but you'd either end up with something that is unreadable, or something with a high collision chance. Neither option is very appealing. For now I'm just going to wait and see.

[–] [email protected] 0 points 1 year ago (4 children)

Unfortunately, Lemmy cannot handle community names over 20 characters, so this won't be possible.

[–] [email protected] -1 points 1 year ago (1 children)

Bad bot. Deploying a fix right now for this, apologies for the spam.

The bad news is that I now know why it cannot clone this subreddit - the name is too long. That's going to take some time to fix, I'm afraid.

At any rate, "bestof" subreddits don't work very well at the moment anyway, since they do not yet retrieve the underlying message.

 

That the replies-everywhere-bug was just because I forgot to include a variable in the bot deployment? 🤦

1
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

In the short time since this instance and bot launched, I've been seeing the same questions resurface multiple times. This is totally understandable, since the concept of a Fediverse is still new to most (myself included), and this server is not like the others.

Q: What is Lemmit?

A: Lemmit is a Lemmy instance specifically designed for archiving Reddit content. Users can request new subreddits to be included in the archiving process by posting in the [email protected] community. It is powered by an open source python bot, which periodically checks the request list, adds new requests to the queue, and continuously monitors the Hot feed of those subs for new posts to cross-post here.

Q: Does it synchronize comments?

A: No, that would be impossible. Considering there are thousands of posts already on Lemmit, many of them having at least several hundred comments on Reddit, often buried in deep layers, it simply wouldn't be feasible to index those for more than a few posts, let alone keep them up to date.

Unfortunately, this means that archiving certain subreddits, such as Ask Historians/Men/Women/Hyperintelligentshadesofthecolourblue-type subs, is going to be rather pointless.

Q: Can it send comments back to Reddit?

A: No, it cannot. The purpose is to help bootstrap the Lemmy platform, not to serve as a bridge between the two networks. Also, see the answer about synchronizing comments.

Q: Can I request any subreddit?

A: Technically, yes. However, as the list of subs grows, the time it takes to update all of them will also increase. I do not have strict guidelines in place for this, so I'm relying on your common sense (hoooo boy). At some point, I will probably have to either stop accepting new requests or disable scraping for very low-traffic communities.

Q: Does this use the API? Will it keep working after July 1st?

A: Nope, it uses a combination of the public feed and scraping old.reddit.com. So, as long as those are still available, it will continue working. And even if they close those sources, there will probably be new ways to achieve the same effect. "Content, eh, finds a way."

Q: This is spam, can you stop?

A: First of all, I apologise for the inconvenience. All you have to do is block @[email protected], and none of its posts will ever show up on your instance. If you you don't want anyone else on your server to be exposed to this bot/instance, you should convince your admin to defederate from lemmit.online. Since there are no other users on here, there will be no harm done.

Obviously I could stop, because running this server and software is only ever going to cost me time and money. But for the reasons listed above, I still think this server is a useful addition to the lemmyverse at this time. But I'm looking forward to the day where I can turn the bot off because it's no longer needed.

Q: What started this?

A: Okay, nobody asked this, but I'm going to tell you anyway. After Reddit made it clear that they are effectively killing third-party apps and implementing plenty of other anti-end user decisions, I realized that I would either have to accept not being able to access my time-wasting content or have to do so in a rather uncomfortable way (either through the official app or old.reddit.com for as long as they'll allow it to exist).

Being a stubborn developer, naturally, I chose option C: Have my own Reddit. With blackjack, and hookers. This way, I would still be able to access my beloved content without being beholden to Reddit's mood swings and abusive relationship tendencies.

Besides that, I also know that Content is King. So I'm order to counter the network effect (No users because no content, No content because no users), I figured it would be better to have some inorganic content to bootstrap the adoption of Lemmy.

Q: Are NSFW subreddits allowed?

A: Absolutely. Like I said: Blackjack and hookers.

Q: My request isn't picked up by the bot!

A: That isn't a question. But yeah, the process isn't flawless yet. I'm trying to iron out all the bugs as I encounter them. In the meantime, feel free to re-request the subreddit by making a second post. No harm done.

Q: No new posts are showing up at all on Lemmit

A: If no posts are appearing on the Lemmit Frontpage (sorted by NEW), it's possible that the bot has crashed or is stuck on something. Since no software is flawless, this sometimes happens. I usually fix this as soon as I'm aware, and I'm happy to say that these kinds of fatal errors are becoming less and less frequent. However, they may still occur, and as a human with needs of sleep and other responsibilities, I'm not always able to fix them immediately.

Q: Posts aren't showing up on my instance, what's up?

A: Due to the spammy nature of the bot, some server admins choose to block this server, and that is completely understandable. So first of all, make sure to check the instances link in the footer of your home server. If Lemmit is the Blocked Instances list, you're out of luck.

When you have verified that Lemmit is not blocked on your instance, try unsubscribing, waiting a little, and then re-subscribing. That tends to fix things.

 

Long story short: I messed up with the domain registration for this instance, and never replied to a mandatory email. The domainname (lemmit.online) got put in suspension, causing disconnects all over the fediverse.

I fixed it as soon as I found out, but it will probably take a few more hours for the issues to be fully fixed.

So ehm. Whoops. Hope this explains and fixes the federation issues we've been having today.

 

Most importantly that the bot no longer crashes (and does nothing all night while I sleep 😛) when trying to create a community that has already been requested.

Furthermore mostly making the code prettier and adding tests.

 

Try again, you lazy bot.

1
Bug fixes 19-06-2023 (lemmit.online)
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

Fixed a couple of bugs today:

  • Nasty one that made the bot get stuck in an infinite when trying to add a post by a deleted user, which kept the bit offline for most of last night.
  • Another creative one that, when posting certain links, would actually work, but the lemmy gateway would respond with a timeout. It only happens on certain links, but consistently. Which would make the bot think it was unsuccessful, which would make it try to post again the next time. Causing a duplicate post each time (technically it was a cross post to itself... Which is interesting in a whole new way).

TLDR: right now there is a workaround in place that assumes a timeout post to lemmit was actually successful. This might cause it to drop posts in the future, but seeing that the server is barely breaking a sweat at this time, it should be good until a better fix is implemented.

Also got some great feedback from users, which I added to the TODO.

[–] [email protected] 1 points 1 year ago

I think @[email protected] wrote something to that effect (I'm still a mess with making proper links on here :/)

And I also found something else that was written in java (not javascript).

The downside from using the RSS feed is that it doesn't contain the whole body, which my scraper does fetch.

[–] [email protected] 2 points 1 year ago

If that's what happens, that's what happens. ¯\_(ツ)_/¯

I'm just here to offer a service for people who Do like it.

 

I have created some software that is capable of synchronising posts from Reddit to Lemmy. It's still a little rough around the edges, but it works as a such:

People can request new subreddits to be mirrored on [email protected]. A bot (open source) will monitor the threads there, and if it finds a new request for a subreddit, it will make a new community on the Lemmit server, and add it to its monitored list. It will then make periodic checks to see if any new posts (it doesn't copy any comments) have been posted on reddit, and copy those over.

Users can then subscribe to those communities from their own lemmy instance, and from there federation will pick it up. Or at least, that's the theory. At the moment, federation is not working awesomely, and that is where my lack of fediverse knowledge comes in. Maybe it needs more time, or something is not so properly - I don't know.

Furthermore: registrations on this server are closed. The point of this service is not to become a community on its own, but to deliver, ehh, "original" content to all the rest of the Fediverse while it's going through a ramp-up phase. Besides, the instance is running on a pretty small vps, and I rather have this thing manage itself. There is a [email protected] community for further questions about the project itself though, in case people want to discuss it further.

So ehm... Let me know what you think :)

view more: ‹ prev next ›