I am one of a network of academic researchers from around the world working on collecting media market data. One problem is that referenced sources often disappear which makes validation later difficult or impossible. So, I thought I would recommend self-hosting something like archive.org that would allow affiliated researchers to submit their web references and have their sources efficiently archived in a central project repository. That would allow validation and continuity for when web-hosted text and files disappear or researchers leave.

I have been looking at ArchiveBox. If you have experience of this or a similar solution, would that fit the bill? The important thing is efficiency for researchers submitting/retrieving pages and files, and openness in structure and formats so that the archive would remain useful if ArchiveBox or similar disappears. FOSS of course means you can't be locked out anyway.

Hi all!

I started my self-hosting journey a bit ago and currently host my own instance of Immich. With almost 30k pictures I feel like I want to find the best pictures and print an actual album for each event/trip/etc whenever it makes sense. I was wondering if there are any self-hosted options for this where I can, given a specific album (or folder assuming there is no Immich integration) it will choose the "best" pictures for printing (I understand that "best pictures" is very subjective).

I'm trying to understand the bot problem in the internet and finding more ways to defend myself. One thing that I can't seem to understand is why most bots, scrapers and crawlers seem to have residential IPs.

• Is it that ISPs are being paid by tech-bros to assign them these IPs?
• Is it that residential devices have been hacked /contain malware that does this?
• Is it trivial for companies to assign themselves residential IPs?
• Paid volunteers are doing this for AI companies?

Or is there is some other reason for this?

Obviously this is a problem because one can rotate / cycle through residential IPs and if I aggressively block each offender in my logs permanently, then the next person assigned this IP who may be a legitimate user will be unable to access my site.

I've heard about Kavita and CWA. Kavita can't fetch metadata sadly and it has too much behind the "+" service and CWA, as far as I know, is not very good for managing Manga and Comic.

Any recommendations? I would prefer it to be able to get it on the same app so I don't have to constantly change IP on Kindle.

Hi /c/selfhosted,

it's been some time since I have posted an update about PdfDing, the selfhosted PDF manager, viewer and editor offering a seamless user experience on multiple devices. It’s designed be to be minimal, fast, and easy to set up using Docker. You can find the repository here.

Since my last post the following features were added to the app:

• Share PDF collections with the public with a link and QR code. Optionally, shares can be protected with a password and a deletion date. Until now only single PDFs could be shared.
• Use bulk actions for managing multiple PDFs at once. Available bulk actions include adding, deleting, starring + tag and collection adjustments. It's no longer necessary to waste time by processing one PDF after another.
• Multi-Factor Authentication. Users that aren't using SSO can now secure their accounts by using a second factor (webauthn + TOPT)
• Other than this there are several minor UI and quality of life improvements that (hopefully) make the app a bit more beautiful and easier to use.

If you are using PdfDing I would appreciate it greatly if you would take a couple of minutes to complete the small survey. This will help me to improve PdfDing in a way that benefits you most.

Last but not least I am quite happy about the nice and steady growth of PdfDing. By now it has almost 300k image pulls and over 1.7k stars. Since the popularity is increasing but not exploding I am not overwhelmed with feature requests and the general maintenance. It also means that I am spared from the attack of AI slop PRs that target more popular projects.

RedMemo — a self-hosted Reddit front-end (Redlib's UI, Go back end) that archives what it serves, so it keeps working when Reddit doesn't. Repo (Go + Postgres, AGPL-3.0): https://github.com/Meeks233/Redmemo Live demo (/settings is TOTP-gated, treat as read-only): https://redmemo.meekslab.cc/

Reddit`s funking constraints. Reddit caps each OAuth identity at ~100 API requests per 10 minutes, and IP-bans addresses that push too hard. The one mercy: media (images/video) is served from a CDN and doesn't count against that quota — only the JSON posts/listing/comment calls do.

Why Redlib runs out. Stateless and unauthenticated — every page view is a fresh upstream hit with nothing kept. Each request pulls only a handful of posts, so the 100-call budget drains in minutes, and there's no outbound rate limiting to pace it. Worse, it still ships a 2023-era official-app fingerprint; against an unchanged, years-old fingerprint, who else would Reddit block first?

Why RedMemo lasts. I supercharged everything.

• HR outbound rate-limit — Main gate for your poor API credits, sync with the dynamic ring at the topbar, which could help you easily estimate remaing credits.
• Control — 100 users rush to your instance, eveyone just clicks one link and your instance is completely disabled for 10mins...? Why couldn`t I just lockdown my instance and leave room for NP ? You can disable upstream service completely at env/settings. (env will persist)
• 5-layer NP (Natural Prefetch) — L1: main cycle (Pull 100 posts at once) , L2: media, L3: comments, L4 sub icon, L5 audio remux(under construction). I try my best to mimic real human behaviour and disperse those requests, so Redmemo just looks like a real user to Reddit.
• Archive — Reddit cant hack your homelab or vps to erase your records at Postgresql. What NP gets will come here and ready to serve.
• Scored cache — You could define cache size (like 1G at env), large and small media are run through a scoring function (LRU+Size) ; eviction is an incremental, low-IO sweep that drops the lowest-value items.
• Fresh fingerprint — Use the TLS fingerprint from reverse-engineering the official client and auto-derive the User-Agent from Reddit's official-app release cadence, so it never goes stale. (However Android version is now pinned to 15)

It's a derivative of Redlib/Libreddit, AGPL-3.0, not affiliated with Reddit.

To be honset, I used a lot of AI — Claude Code (4.6 through 4.8). But core codes were reviewed. The designs (NP, HR, the scored cache) are mine. If you could write better code, we will be very glad to see a new project inheriting from Redlib. Our beloved Redlib just lacks maintenance for almost 3 years, I just try to prolong its life. Anyway I`m just a college student using as much spare time as possible in the last 2 months just try to do something for community...😥

A number of brand new accounts have popped up shilling their paid for applications.

Is this within the rules? Is the community happy with this? Could mods clarify this in the rules?

Either allowing advertising, or banning it entirely.

my point is - there is a difference between an open source homegrown project that might be useful, vs closed source paid for projects from brand new accounts

some replies are misunderstanding, somehow.

I am against

brand new accounts who:

1. first post is a brand new project
2. project is closed source
3. project will cost money
4. is asking for free testing
5. the post is literally an advertisement

cross-posted from: https://discuss.online/post/41558684

Setup listmonk and now wondering about suggestions for how to maintain a basic list and campaign. Wondering about a few things:

• Privacy. All I want to know is if people are actually able to read the posts.
• Any thoughts from others who've been managing their own lists / campaigns.
• Basic idea is to use for email and RSS to post updates on latest happenings, maybe once a month.

Just want this to be both successful and not annoying. 😄

I've been building DepthSight for the past year - a self-hosted algorithmic trading platform that you run entirely on your own hardware, so your API keys and trading logic never touch a third-party server (like 3Commas or Veles).

Instead of writing code, it features a drag-and-drop node editor (40+ logic blocks) where you can build complex strategies, cross-reference indicators, and manage risk dynamically. It also includes an AI assistant that can generate strategy structures from text prompts or even screenshots of chart setups.

Since Lemmy is built on federation, I thought you guys might appreciate the architecture: DepthSight nodes can opt-in to connect to a central Federation Hub. This creates a community network where self-hosted nodes can share verified strategy templates, discuss trading ideas, and form a global node topology map.

Features out of the box:

• Visual strategy builder
• Federation Hub
• Dual backtesting engines
• Dynamic risk management that adapts per trading pair
• Multi-tenant support (JWT, Redis quotas) if you want to host it for others

Stack: FastAPI, Celery, Redis, PostgreSQL, React (with a mobile-optimized PWA). AGPLv3 licensed. Runs with a single deployment script (curl | bash).

Github: https://github.com/DepthSight-Pro/DepthSight

Built this solo (heavily leveraging LLMs for the heavy lifting in code generation). Would love to get some feedback from the self-hosted community, especially on the architecture or features you'd want to see added!

I've been racking my brain the whole afternoon trying to figure out why when I try to access my Pihole over Web GUI suddenly I'm met with SEC_ERROR_UNKNOWN_ISSUER error.

My setup:

• Nginx (SWAG) runs on my server and routes all apps on the server, plus two separate devices (Unifi and Pihole)
• Pihole runs on a Raspi with a fixed IP
• Nginx conf points to Pihole's IP on port 80 over http protocol.

This worked perfectly fine until several days ago (well, that's when I noticed the issue). Now whenever I try to access Pihole over its FQDN (https://pihole.my.domain/), I get the above error. The reason is mismatched certs, i.e. my browser fetches Pihole's self-signed cert and doesn't see my domain's cert at all. However, this shouldn't be happening at all. Nginx conf points to Pihole's port 80, not port 443. To further confirm this, I temporarily disabled port 443 on the Pihole and only served on port 80, which made Pihole web inaccessible over Nginx. I thought maybe Unifi is the culprit, but I can still reach the Web GUI over http://pihole.my.domain/ and http://pihole-ip/ through my browser. I have several other apps on the server that use port 80, and Nginx has no issue routing them.

Anyone has any idea what might be happening here?

Hi fellow selfhoster,

Im a bit lost on the following scenario and im unable to find any documentation about it so i was hoping some smart people here could point me in the right direction.

I have a linux software raid 6 that contains a LUKS partition with ext4 in it. I would like to automount the ext4 when im rebooting. The root partition is also using LUKS and i have successfully setup the decryption for this parition but im uncertain on how to do this with this raid setup since im not sure where in the boot process linux recognizes my raid and when the decryption happens.

This is what i have:

[root@nfs-rocky-1 ~]# cat /etc/mdadm.conf
ARRAY /dev/md/server1:0 metadata=1.2 UUID=3e198408:2236ed3d:1dc13a8e:e5f91e52

On a reboot the raid does get automaticly recognizes but i still have to do cryptsetup luksOpen /dev/md0 raid & mount /dev/mapper/raid /mnt/data.

What would be the best way to do this? Im a bit scared of doing this im not certain of since i don't want my machine to be stuck at a boot.

Just a like to an article that dicusses something like this already would help me greatly.

Hey, folks. The Jellyfin and Komga media servers running on my NAS are going great locally. I invested in a firewall and some managed switches, and from preliminary VLAN tests, I'm confident that I've got what I need to section off the self hosted services from my primary network. I was hoping to get a recommendation for the next couple of steps.

I've got a mini PC running Bazzite that had been a portable console/fighting game setup that I'm ready to retire from that role so that it can serve as a server and reverse proxy. I'm not sure what OS to put on it. If I have to manage it entirely by command line, it will take 10 times longer for me to do anything I want to do, and I'd really prefer a GUI. That said, I know it also takes resources to power a GUI that I won't be touching most hours of the day. I was curious what distro you folks might recommend for this purpose. In some of my research, I also came across Apache Guacamole, but I'm not sure if that requires a proper desktop environment to already be present in order to get that kind of remote access with a GUI. Am I overthinking this? Is this going to be just fine with a normal desktop distro installed on it? If normal desktop distros work just fine, I need something that can sit there without updating until I tell it to; since introducing snaps, this is something Ubuntu has been a pain about, so I might want something else.

The next thing I was curious about was order of operations for the reverse proxy. There are SSL/TLS certificates that are needed for HTTPS, but I need a domain for that, and a lot of tutorials just skip on past this step in the domain configuration screens where you "enter your DNS servers" as though I know why I'd need other DNS servers, where to get them, how to select them, etc. And ideally, I'd want to test that the reverse proxy is working locally with HTTPS and all before it's exposed to the internet in the first place, so I'm not sure what order to do those steps in: DNS servers, buying a domain, getting certs, configuring reverse proxy.

As with most things, I'm sure this is far less complicated than it looks to me right now, and once it's in the rearview, it will make a lot more sense, but I'd appreciate any advice folks here can offer.

So I guess you can just hook up IPTV directly into Jellyfin. But there also seem to be helper apps like xTeVe, Dispatcharr, Threadfin, and others?

Are these helper apps worth an install? I'm curious if anyone has a favorite.

I've been building PRISM - a self-hosted OSINT toolkit you run yourself instead of pasting investigation targets into someone else's web service.

Give it a domain, IP, email, phone, or username and it runs 22+ modules in parallel into one dashboard: WHOIS, DNS, crt.sh subdomains, GeoIP, threat intel (Shodan/VirusTotal/AbuseIPDB/Censys), breach data, username search across 3000+ sites (Blackbird + Maigret), dark-web mirror checks, and more. Results come with an entity graph, a GeoIP map, an OPSEC exposure score (0–100), and HTML/PDF/CSV/Markdown exports.

14 of the 22 modules work with zero API keys (missing keys degrade gracefully instead of erroring).

Stack: FastAPI + Next.js 14, runs with one docker compose up. MIT licensed.

Demo: https://getprism.su/ Github: https://github.com/NovaCode37/Prism-platform

Built it solo - feedback welcome, especially on which modules you'd want added.

I'm looking to expand into having a online library and looking for some real world experiences and opinions. Ideally, looking for someone that worked well with docker and the various arrs.

Two days ago, I posted to this community asking for help with managing subtitles and audio tracks on my media server (and removing the ones I don't need). @ohulancutash@feddit.uk suggested I try Muxarr which looked promising, so I set it up yesterday.

First impressions were good, the setup was really easy and I set up the profile I wanted in around 10 minutes (only keeping the English and original audio tracks, and only English subtitles). I enqueued all my files (there's a big green button in the top left which I somehow missed for a few seconds, but that's on me) and it started doing its thing. It did take a while to process my nearly 3000 files so I left it running overnight. I came back this morning to find it had worked perfectly and all my media had the unwanted tracks removed.

What's possibly even more impressive though, and something I wasn't expecting, was that removing all that unneeded data had freed a whopping 135GB of storage!! I only have 8tb available total and with storage prices as they are right now, that's really quite a significant amount to just be sitting there holding data that will never be used.

I just wanted to take a few minutes out of my day to write this and thank @ohulancutash@feddit.uk and this community for recommending Muxarr to me and spread the word to others who didn't know about it like me two days ago

Cliparr 1.2.0 is out, with many small improvements and a new convert tool.

Cliparr is a self-hosted browser-based personal media clipper. Load up Jellyfin or Plex to the moment you want to capture, open Cliparr, and export.

What's New

• Offline, browser-based video converter with GIF support.
• Fix Jellyfin HLS streams not transcoding
• Add user-select filter for popular servers

See the release notes: https://cliparr.dev/changelog/#v1.2.0

Read more about adding GIF support to Cliparr, it wasn't as simple as it sounds: https://cliparr.dev/blog/convert-video-in-your-browser/

Progress Report:

So, building on @captcha_incorrect 's n8n script he graciously offered, and pulling data into Grafana, and learning how to python correctly....it's been a journey. However, I am happy to report that I have some weather data now. It's by no means a finished product but I have made some progress.

The extended forecast in the right hand side took me some time to figure out pagination so I could scroll through 5 days in advance. The weather tab at the top left will get a couple more tabs. One for forecast map, if I can figure that out. LOL

I've been using this as my e-book library management for a couple of months now, ever since switching from booklore, which imploded a bit.

I just noticed today that it hasn't shipped an update since February, and in fact there's been essentially no activity on the GitHub page since early February. Four months is not that much time without an update, but it is a pretty long time without any new commits. I'm not seeing the lead developer replying to reports, etc. Is this still an active project? Does anybody know? It seemed like there was a lot of enthusiasm behind this project six months ago, so I'm not sure.

Edit: There is an active community on Discord that is working on updates. There is a fork with bugfixes here.

Let's say you have access to a remote machine and use it to copy backups occasionally, eg with rsync. Your local machine has credentials stored that allow write access on the remote machine, however if the local account was compromised that could also allow access to the remote machine and the data stored there.

How can you grant access to an account to write remotely, but also protect the data from this account? One possibility could be to change the permissions on the data after it is copied to prevent deletion/interference, although I'm just making this up. Is there a standard practise for this?

I'm running Monicahq on Pikapods. v. 4.1.2. I've entered my email address in the settings>General. After this email address it says "This is the email used to login, and this is where Monica will send your reminders." However, I'm getting no notifications.

I've tried looking in the monicahq manual. The documentation doesn't appear to correspond to my version. I can't find this in my instance: https://docs.monicahq.com/user-and-account-settings/notification-channels#anatomy-of-the-notification-channel-list

The documentation says it's possible to send test notification:

https://docs.monicahq.com/user-and-account-settings/notification-channels#send-tests-and-logs

I can't find a page where I can send a test notification on my instance.

How can I fix notifications? Any help gratefully received.

Is it your local server, which streams music for your PC and phone? Is it something else?

What about streaming music from your server to your work laptop?