12
[AIT] Local LLM for Server Setup Guidance?
(lemmy.world)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 26 Jul 2026
12 points (66.7% liked)
Selfhosted
60951 readers
770 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
-
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 3 years ago
MODERATORS
Is it just for local usage on their network or will their be remote access via the internet? What OS are they installing on? Are they familiar with installing the OS?
In my experience Jellyfin is an easy install and easy to manage.
I run a few servers on an old laptop and I've messed up some random other shit on the laptop then wiped it one time, moved to another OS one time, moved to another machine another time. So I've setup Jellyfin I think 4 times now.
Overall it's pretty easy in my opinion.
2.Log into router and reserve that IP so it stays with the device. (This will vary by internet service provider, if unsure look at the gateway you found in the last step, if it says 192.168.1.254 or such, that's it)
(Standardly something like: sudo ufw allow 8096)
If you like using docker like many do then you may prefer to do it in a container.
Anyways that should bring it up. Then go to http://the.ip.address.found:8096/ and go into the dashboard to set up users, pick what access they have.
Also where you'll set up the libraries, so say "Movies" and point it to where you store them.. you can point it to multiple directories
Oh and if a laptop change the close lid settings to keep machine on when plugged in and lid closed. Set all power settings to not go to sleep.
On an aside I set my VPN up as a split tunnel, easy, just Google your VPN and split tunnel, should only take a few clicks. I set qbittorrent and firefox traffic to go through the VPN, then I have everything else stay on local network.
I install Rustdesk on my phone and laptop, then remotely access the device wherever I'm at. Use the search function in qbittorrent, tell it to download sequentially, and download to the movies directory I want, launch the jellyfin app on my phone, hold my finger down on the movies folder, tell it to refresh meta-data and then launch the jellyfin fin app on one of the tvs.
Some time from "do you want to watch ____" to starting to watch it is ~3 minutes. If the movie downloads faster than you watch it, should have no hiccups