12
[AIT] Local LLM for Server Setup Guidance?
(lemmy.world)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 26 Jul 2026
12 points (66.7% liked)
Selfhosted
60951 readers
770 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
-
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 3 years ago
MODERATORS
Maybe a easier place to start is a beginner friendly system? Lots of people like running Unraid for example, and they have lots of apps that will make it easier to get into (https://ca.unraid.net/), that might help ease them into it. Being thrown into a Linux terminal might feel daunting, but also a great way to learn.
I think many just need to get hooked on it, then they more naturally feel like they want to customize and try out stuff.
I dont have any guide recommendations, since its been a while since I started. You can probably do some searching on the stuff you want them to setup.
I asked mostly because I haven't seen any guides like that. The long video guides are also usually outdated or a very specific method that's more advanced (like bare metal setup or using ignition)
My plan was to lead them through something like what I use which is base Debian using Dockge and a reverse proxy (though I'm looking into KDE Plasma BigScreen). I think they might be able to figure it out with help and some general written instructions and the AI for further questions.
For the arr stack the best resource I know is https://wiki.servarr.com/ which I referenced for my setup in Kubernetes.
Most projects have pretty good documentation on how to setup their services, in many cases its just the Docker config afterall.
It's a good reference guide, yes, but it's not good for beginners. The linked TRaSH guide seems better but I think are still a lot.
The issue I've found when searching for resources for them is that there's really no guide me for people who know very little but want to do this and guides them in the proper steps from beginning to end. I have an IT degree and even I remember struggling a little bit when I first delved into self hosting because I never really studied networking, and networking feels like a different field entirely. Right now self hosting in general reminds me of the early days of Slackware (maybe even SLS) Linux (for those that remember) - you kind of have to ask around and figure things out on your own through a bunch of lookup.
I'm trying to ease the friction a little bit for those that want too start, and want to see if an LLM that can quickly define some words and tell you not only where to start but the steps after that based on your skill/knowledge level can ease some of that friction.
At least until one day self hosting becomes about as easy as modern Linux.