Morning all,

Quick question, how do y'all handle big "unofficial" collection torrents with weird folder/file names that were manually added to the download client?

Is there a nice tool to use or are manual scripts the only way?

Also, how can I tell my *arr stack to look for files inside collection torrents too? Say I want Iron Man 1, but the only torrent with sufficient seeds is e.g. Phase-1.MCU.1080x720p or some weird ass name like that, that contains Iron Man 1 along with all the other files. How can I tell Radarr to use that torrent?

Thanks! Have a good one

edit:
I needed to edit ~/.config/qui/config.toml and bind the host to "0.0.0.0"

I'm running Debian (12) and I just installed qui, a single binary dropped in /usr/local/bin. When I fire it up, I can access the web interface on the local machine via localhost:7476, but I cannot access it over the LAN via the server's IP. Firefox just says 'Unable to connect'.
I can access a dozen other services over the LAN, and as far as I'm aware there's no firewall enabled by default.
What gives?

I have noticed that my home server is strangely using lots of swap (~5 GB), despite having only a few lightweight processes running and loads of RAM installed (32 GB).

Upon configuring Grafana + Prometheus, I noticed a trend where cache + buffer will progressively increase until swap starts to be used. My system and services combined will use ~8 GB RAM. Upon rebooting, the cache + buffer will start anywhere from 3--10 GB, progressively ramp up to ~25 GB in 1--2h, where swap will start to be needed (~3 GB). See the image attached for reference.

My swap filesystem is on an expensive (to me) SSD, and I would like to reduce its wear by as much as possible. I understand that swap can introduce only minimal wear on SSDs depending on its nature and that it can be harmless, but I am still not sure what is causing this behavior (and why) and whether I should worry about it or not. So I figured I should investigate what is happening here.

My main question is, how can I figure out what is causing this behavior? Is it expected? I am looking for guidance from others who are more experienced than me in the topic.

A little bit about my system:

I am running Debian 12 on an NVMe SSD containing the root partition (btrfs) and docker services. I also have two HDDs, one with persistent data (ext4), and the other with backups (ext4). This is majoritarily a single-user machine. I tried using the following kernel parameters, but it hasn't helped:

vm.swappiness=10
vm.vfs_cache_pressure=200

My docker services are:

• *arr stack
• jellyfin
• nextcloud
• immich
• open-webui + ollama
• pi-hole
• invidious
• romm
• nginx proxy manager
• grafana + prometheus
• other minor services that I don't think are doing much (uptime-kuma, stirlingpdf, vaultwarden, etc)

I'm using Frigate with these TAPO cams:

Tapo 2K+ Indoor/Outdoor Wired Security Camera, Baby Monitoring, C120

The CAMS support the RTSP protocol, which works with Frigate.

Yes the cams support audio mic and speaker when connected to the TAPO service and using the TAPO phone app.
But I do not want to use TAPO's service and their app / servers.
I keep my cams on a separate router / subnet which does not have internet access.

Only my Frigate server has a network interface on that subnet, so it can access the cams feeds via RTSP.

Now I would like audio intercom so I can listen to audio or talk through a speaker using the Frigate phone app.

I don't see such an option in Frigate.
I see there is something called "go2rtc" but I'm not sure if these cameras support this. Or even how that protocol works.
I'm willing to buy a new cam, different model or manufacturer if necessary is fine.

How can I achieve this?

There are some services that I expose to the internet (using Apache reverse proxy) that really should be accessed by only a small set of devices. Requiring client certificates seems like a great way to reduce the attack surface and prevent brute force attacks (since the attacker doesn't even get a chance to attempt a login).

I wonder about the difficulty on the client side as well as other practical implications. The clients are smartphones of various makes.

Paperless cloud backups

https://samsm.ch/paperless-cloud-backups/

Some documentation on how I setup backing up my paperless-ngx documents to dropbox using rclone and some custom code

#homelab #selfhosted @selfhosted

Hi!

Over the past month I've been working on a small self-hosted service which would let me auto-import, categorize and rate all my games (and make them easily explorable for family members). Think of it as a self-hosted backloggd.com. I believe it's now in a good enough shape to share, hence this post.

It all kinda started when my gf was complaining that browsing our family library on the Steam Deck is a pain, because the library view barely gives you any information on what the game is, and the store page has way too much information (and loads way too long). I then remembered how I dropped off from using Backloggd and Infinite Backlog several times right after registering (either due to the lack of autoimports, or due to the very involved process of actually going through your library to categorize stuff). So I figured I'd finally make my own thing, with blackjack etc, etc.

You can play with a read-only demo snapshot of my library here to get a feel for it: https://iri-demo.fly.dev/

It's written in Elixir with Phoenix LiveView and uses SQLite for the database. The code is licensed under AGPL and is on GitHub with a mirror on Forgejo.

It lets you automatically import your games from Steam, GOG and XBOX. For PSN it gives a JavaScript helper that you can use on PSN's web page and for EGS you'll have to use Legendary's JSON export. I know the last 2 are not ideal, but I'm not sure what would be a better way to approach this, given that everyone but Steam is incredibly API averse :^( Open to suggestions though!

It does not yet have Battle.net, Origin or Ubisoft integrations (primarily because I don't use those stores), so contributions are welcome.

Here are some of the other things that it can do:

• It has a nice bulk-edit mode, so that you can actually get through your library and mark stuff as completed, dropped, etc.
• It supports family sharing (again, my initial use-case was that I wanted my gf to have an easy way to explore my library).
• It fetches ProtonDB and time-to-beat data.
• It let's you create custom collections, which can be then exported either as .txt along with notes and store links, or even as a static HTML website.
• It has a responsive layout and it has (admittedly somewhat rudimentary) gamepad (and keyboard) support, so you can browse on mobile or on the Deck. It should also hopefully be usable with screen-readers, but I would appreciate any feedback from actual screen-reader users.
• It has an optional AI integration to automatically map ambiguously named games to IGDB entries (otherwise for ambiguous titles it will leave the mapping choice to you)
• Filters, search, private notes, probably something else I'm forgetting - the post is already too long anyway

It doesn't require credentials for any of your stores, but it does require public profiles for Steam, GOG and Xbox. You will also, of course, have to bring your API keys with you, where needed: the app heavily relies on IGDB, for Steam you need Steam Web API key, for Xbox I opted to use xbl.io, and finally for the AI integration you can bring your OpenAI-compatible or Anthropic key (or you can use a self-hosted model, though I haven't really tested that tbh).

I literally have no idea whether it's something someone besides me will find useful, but in case you do: here you go, let me know what you think.

AI disclosure: the majority of code was generated, with a lot of iteration and guidance. In my mind, if there exists a valid usecase for AI coding - it's stupid lil pet projects like these, as I never would've finished it on my own. I'm sure there's some slop left in there though, so be wary.

Design - Pair
Implementation - Generated
Testing - Pair
Documentation - Pair
Review - Me
Deployment - Pair

Does anyone else here participate in the selfhosting hobby without a formal IT related education or a career in a similar field? I've only had one or two programming courses as part of my university education, but it was only very basic Python and C. I've never formally learned how to use containers, version control or anything else. Sometimes I regret not pursuing an education in IT/programming because there are so many things I'd like to accomplish but can't (for example if there's a feature missing in some project, or to feel safe in my abilities to harden my servers and my network in order to expose services to the open internet).

Homepage is a dashboard for all your services with plenty of plugins to have the services status displayed in one place

cross-posted from: https://lemmy.ml/post/51469097

A full-featured 2D + 3D CAD application built in Rust with GPU-accelerated rendering. Native DWG & DXF read and write, paper space, ACIS solids, dimensions, layouts. An open source community project by Hakan Seven, recognized and promoted by the OpenAEC Foundation.

How to build the web version.

My blog is now an international success. I get like 3 hits from Google a day. That's what they call Seomaxxing. Or not. Depends who you ask.

Nevertheless, I noticed my audience comes mostly from outside Europe. My server sits in Frankfurt, so the only reasonable choice was to put a global CDN in front of my static Astro blog.

Easy, I thought.

I jumped straight in without reading anything first. What could go wrong. A lot, actually, and I can now confirm that the error pages from Bunny.net look really nice.

Got it working anyway. Full writeup on said blog, blazing fast no matter where you are:

https://hmmr.online/posts/bunny-cdn-for-a-static-blog/

So I asked if I was an idiot for coming up with the bright idea to start my own lemmy instance. Well I can proudly state that yes, I am an idiot, but I'm an idiot with his own lemmy instance: MopLemmy.fyi. Barebones and barely federated, but by God it's mine.

A brief summary of the issues I ran into: Lemmy Easy Deploy was absolutely the right way to go, thanks ᛒᛚᚢᛖᛇᚦᛖᚱ@no.lastname.nz for that suggestion. I've very new to several aspects of this so just understanding containers and when to use LED commands and not standard container commands ended up being the biggest hurdle to deploying the instance.

Email. Everything about getting the SMTP setup was basically terrible. Brevo won't let you make an account using an email address with a "." in it, so I ended up needing to make an email account so I could make an email account. Then I was troubleshooting a typo error for too long, and then I was troubleshooting a bad bit of info I got from the internet which had me using my account email address instead of the Brevo created one for the SMTP, so those were human error and by far the single most time consuming issue.

Second to that, a script to check if my external IP address changed. This ended up being the single most annoying thing, partly because of my newbity. I was using Remote Desktop Connection into my Linux box and copy and pasting stuff. Copy and paste was screwing up the data and kept breaking things. Once I realized that and switched to SSH things went smoother. I know, rookie mistake.

Setting up backups to my RAID that I could then access from my Samba share ended up being another issue. First it was saving to the wrong folder, then I thought I had broken my Samba share and couldn't access it from the network... and the problem ended up being UFW because I forgot to allow Samba through the frickin' firewall. Oh and then the same thing happened when I was trying to look at my Netdata but at least that time I figured it out much quicker.

Those were the major annoyances, the rest was more about the learning experiences of finding out certain things were a lot more complicated than I thought they would be. I did not expect to have to put so many different DNS records. I didn't expect to have to spend so much time deciding on white list vs black list federation, or host images local or not, or image retention, etc. But it's up and stable and working and I am very slowly federating to more communities and deciding what all I want to be able to see. Thanks to everyone on the original post with advice and suggestions, even the people who suggested things I ended up not doing, heh.

I've been using Linux for decades, I've worked as a software engineer/architect/sre for around a decade, but networking has always been my biggest gap in knowledge.

I have a local server, I have caddy spun up, a glinet router running their version of openwrt, and I have a domain name purchased through porkbun.

I am looking to setup "local.domain.com" to point to my local server, ideally without exposing it publicly, and enable devices on my home network to be able to access it from that url. Id also like to be able to access containers running on that server by something like "searxng.local.domain.com" or "local.domain.com/searxng" aka without using the port suffix. Id also like to enable https.

I have read so many guides that have fragments of what I need, but nothing that ties enough together to get it working. And with all the options around different domain registers, let's encrypt, reverse proxies, etc, im struggling just a bit.

Are their any guides (prefer text over YouTube, but beggars cant be choosers) that people recommend that encompass the whole process, instead of just pieces? Id like to understand it instead of just fumble through it.

I use open source self hosted software everyday. I love the community and I would love to be able to contribute to some of these projects.

As far as code goes, I basically no nothing about how it works. I see the development section of the repos I use and again, I've go no idea how it works.

How can I teach myself how to offer small improvements to the projects I use?

Right - ran a search and got no results, so am asking directly

This thing any good? Anyone run it?

https://circlus.org/

Use case: want to give my kid a SEVERELY locked down Moto E (2nd gen) as a Youtube music player device and a "message Daddy" app - strictly wifi / in house only.

The first thing is simple enough. The second thing is...interesting.

I had my local AI do some research and it spat out the above. I don't think it's quite right but It looks interesting. Any one use it / can comment? Failing that, can anyone recommend a simple WLAN messaging app that will run on Android 6 / lineageOS? I'm sure I can dig one up but if someone has one running, I'm all ears.

PS: I'm not looking at using a VPS for this...but the above did catch my attention as fairly normie friendly. Might be worth self hosting something like that...

So last night my firewall decided to say F you Reann and stopped working for no apparent reason. I called my ISP to see if it was anything on their end but it was a big nope. It was rather late at night and I do not have computers with monitors at my place so I thought I was SOL. I was frustrated that I could not do anything because I had the bright idea of deleting one of my two static IPs out of the router and than reboot it. I thought to calm my frustrations I would play some games on my ipad, and holly poop am I ever not used to all the ads in mobile games. Luckily my youtube ad blocking does not require anything else on my LAN so I put on some videos and went to bed. In the morning I remembered I had a ethernet to USB adapter and a USB A to c adapter so I would be able to fix it that way. Don’t know how many times I needed to fix the firewall because I broke the internet trying to fix my boo boos and a few times the firewall just said F you Reann I am not putting out. But it is now fixed and I can enjoy my moble games and web browsing mostly ad free!

So I had no pihole action on my LAN.

Like seriously how do people hand how many ads are shoved at you when you are using your devices?

I was on DuckDuckGo this morning trying to fix things and wow the ads, really made me miss searXNG.

Luckily I do not get spam, I spin up a new address for everything so I did not get those ads at least.

that hard drive prices return to normal and think about all the things i can build.

silliness aside, i honestly sit there and plan it out. i wish i pulled the trigger and started earlier. i actually bought two mini pcs before this mess and have one setup running proxmox. o have this beautiful jellyfin -> jellyseer -> radarr/sonarr -> sazbd -> gluetun -> newsreader setup on proxmox and i founf 1 8tb wd red plus on sale that i put in a ugreen nas running truenas and its filling up quickly.

i wont move to nextcloud until i get a second drive for mirroring. i still have to find a place to backup those future files as well.

there is not really a point tp this post except i know people here feel my pain. how i dream of buy a few 12 tb drives.

for now i find stuff and put price alerts on them. o have tried ebay but i dont always get what i pay for. like buying wlanlisting that says wd red plus cmr and getting a wd red (non plus) smr.

i fantasize about the cool rack setup i could build. right now everything, jellyfin stack, home assistant, glance dashboard, pteradactyl, netbird , anf any vm i want to play with all on one proxmox mini pc. next comes books

sorry for the rant but maybe you can relate

Of the many useful things I could do with my spare time instead I'm setting up a Lemmy instance because why not. The scope of this is definitely greater than any self-hosting I've ever attempted, so please feel free to tell me just how much trouble I'm in. I'm just giving the broad strokes to see if I've made any crucial errors (other than deciding to do this at all).

And if this is a completely wrong place for a post like this or I'm missing data I'm supposed to include I apologize, I probably need a sanity check, in more ways than one.

First limitation, I'll be hosting it on an existing Linux Mint box acting as a file share mostly and occasional gaming PC/movie streaming box. Its hardware is overkill for this, I do not anticipate issues when it is in use. It receives regular updates and weekly reboots, instance will be set to automatically restart. NVMe with loads of space for local storage, RAID SSDs for data offload/backup.

Second limitation, I hate Cloudfare and Oracle. I do not want to use either of them.

Third limitation, money. Cheaper is better. I have a URL picked out and a registrar which will give me the cheapest long term option, in case I actually keep this thing going.

Last limitation, I'm already in over my head so I'll be relying on a lot of googling and probably some chat bots to figure things out as I go through the actual deployment process. What could go wrong?

So, Lemmy hosted on Linux Mint box using Docker containers. ISP is a good one for this I'm told, no CGNAT, largely stable public IP but I'll have a script running in case it does change. Confirmed ports 80/443 are open. Using Caddy for the HTTPS. Closed registration to start, if by some miracle I make it to actually wanting to allow additional users it will not be fully open, and I'll use Brevo for the email SMTP. Security wise I know I'm making it harder for myself by exposing my IP, I'm going to have UFW running and Crowdsec to help keep incoming bad traffic out.

Down the line I'll get Lemmy updates, backups, retention rules in place/automated, and make decisions on federation, etc. Thoughts?

I’ve got an HPE R1500 G3 UPS that I was given and refurbed to be useable. Now that it’s in the rack and running, I want to fix things up a bit more.

Unfortunately the ears were not given with the UPS and I’d like to replace them. However everything I’m finding is listed as intended for switches/routers. Can anyone point me in a good direction, other than just watching eBay, where I might be able to get some replacement ears?

TIA

Edit: The ears WONT be bearing any weight, it’s just to keep it in place so it stays in until I want it out. I know it’s too heavy for ears alone.

I'm looking for a server I can host in my home that has a simple ui where I can put in URLs for download and have them all show up on my Jellyfin. Bonus if there is VPN support.

Update: Thanks to everyone for the suggestions! Several projects to check out: youtube-dl, pinchflat, ytptube, metube, tubearchivist, yt-dlp-webui, ytzero, igloo, youtarr

Birdnet-go is a real-time sound analyzer that detects bird species. It can take in audio from microphones. I set mine up to stream audio from my security cameras that I already had installed. There's even a Home Assistant App, if you're using it.

I live in a more suburban/semi-urban environment, but was really surprised to so many different bird species.

A few weeks ago Rayfish was released and only worked on PCs. But today I checked and noticed V2 was out. I updated my V1 on my PC and then installed it on my phone.

I had to restart the network on my PC to refresh the VPN networks I had already created. I setup a searcXNG on my PC just to try some sort of server. Next I created a firewall rule for that port on the rayfish network and another rule for the network on my Linux firewall. On rayfish I created a network and an invite code for my phone. On the phone I entered the invite code and was immediately connected. I could then ping from my phone to my PC and viseversa.

Finally I searched for the PCs rayfish IP and just connected to it on my browser on the phone. That worked and I was happy. But then I turned off my WiFi on my phone and clicked refresh... A few seconds later the phone re-connected and I got to my searcXNG!

My outside IP is not fixed and I rely on Cloudflare. But none of my services are actually public and are not planned to be public. So now with rayfish I get a permanent IP for free regardless of what my actual IP is. The possibilities are endless.... Big big!

This is very cool! Yeah it's AI developed, but this is AI for us. It's clear and well defined for me, AI working for us is small potatoes vs AI the evil resource sucker spy tool. So let's take advantage. Specifically this project is great and solves my privacy issues with Cloudflare.

Bug Maybe I'm putting it too simply. Any thoughts on this?