Ansible.

I ssh into it twice a year to perform updates but otherwise i leave it alone. Server's been chugging along for like a decade now.

I spent a while getting Ansible to be able to setup and maintain my server(s). And ended up not using it as much as I should, mostly because the computer I used to run Ansible from became a "Steam Machine" so I'm rarely sitting on it with a keyboard now and I don't want to have personal info and keys on my work computer.

But it was a good learning, and useful while I used it. Now I just use ssh and compose files directly.

Poorly.

Usually I put handcuffs on her every night, to keep her off of me, and only feed her the highest grade sushi and meat. It keeps her hair shiny, keeps good health, and complaints down to a minimum. I make sure she gets adequate sleep on an expensive mattress while I sleep on a 2 inch futon on the floor.

Oh wait... wrong kind of server.

self hosted gitlab. each server has a repo with all the docker configs and application configs. also have any scripts for the server itself on there as well, things like required libs, network configs, etc.

I also have a repo dedicated for let's encrypt SSL that retrieves new certs every month. then on each server is an install script scheduled that pulls the certs down, installs them, and restarts any services automatically.

should anything go wrong, I have a siem monitor that will alert me that a service failed to start etc.

currently running four servers like this with varying degrees of complexity.

I just use ssh and manually type commands. Keep doing it and you will get good and it will become second nature.

No need to burn tokens on basic tasks.

Master your tools. Learn awk, sed, just, etc.

Some shell customisation can help. For example I'm fond of zsh-auto-suggestions and skim. Makes me quicker.

I wait for something to break. Then I yell "God fucking dammit, I don't have time for this right now!" and spend an hour triaging things before I just try docker down, pull, up and everything works.

A mix of prayer and bash scripts.

It’s good to get comfortable in the command line, including over ssh.

Especially considering ai and documentation along the way?

If I am going to ask AI or Google about something, I just do that to help me find the answer and then apply the answer myself. That way I learn, and can double check the AI isn’t hallucinating, at least on in obvious ways.

As for documentation, I keep a notes folder with detailed notes on manual configuration I’ve done, how and why, and the things I’ve learned along the way. I’ve found it’s both useful to help remember the things I’ve learned, and it is useful to go back to refer to.

I write my NixOS configs in my PC, commit to the repo, then push it to the server. Then SSH in, and apply it. Or more likely, MOSH in.

I have a git repo with all my docker files, config, notes, etc. I have a main overview file covering the overall system and then a directory for each machine. I edit things on my local machine, then scp and ssh to the various remotes. Once I’m happy with my changes, I commit and push to my Forgejo install on my NAS in case my main computer fails. Secrets, passwords, and keys are in my Vaultwarden.

I don’t use AI for it, but a local model could probably give me the commands to do whatever I wanted based on the repo.

I've been using a program someone on Lemmy has been writing: SSHPilot. It helps keep my server list organized and can easily ssh to the machines or open up a file browser for easy drag and drop of files if I have some quick files to move around. It copies ssh keys easily as well.

My target is terraform to provide VMs on my miniPC and ansible to configure them. For my nas, probably a basic distro then some ansible stuff to setup stomate.

I use ssh with tmux

Ansible is one way to "code local, push to remote(s)". Can define so-called playbooks, which is basically just a script, to do reoccuring tasks like e.g. updates.

"code local and push remote" is only more efficient if you have a faulty connection with ssh or want to use a GUI editor that doesn't support remote connections. What you're doing is good. You can scoure for more "modern" ways that might have more glimmer and sparkly lights, but it won't improve efficiency.

I'll take the maverick and share my niche position. I did most if not all my proxmox setup and configuration via complete reliance on LLMs. Now, before anyone says "why would you do that", and I'll be straight up. I was high for all of it, and not a small blaze I'm talking regularly stoned for months. And I'll say it "got me by" for the frame work. It worked? Sorta. Music, Plex, immich, docker, arr stack, podman. Now, I can't say I fully understand it still and I've done a lot of changes since that point last year and I figured it out by asking the model to backtrack what we did and I wont lie it helped me better learn how to question the models for my job, and It did decent documnetation over my server. But again, I was literally high doing it

I created git repos on my main workstation for each homelab server/service I maintain that keeps:

• documentation
• notes
• lessons learned
• scripts, configs
• runbooks
• backup details
• security audit details
• log items that need attention
• infrastructure

I just point a local LLM (offline model that runs on my workststion) into those repos and ask it to perform certain things on those servers. It can do things like update packages, install packages, make config changes, set/check permissions, read logs (and fix errors in real time), and check the health of the overall system.

I have it run pre backups before making changes, then post backups once its done.

Once changes are in place and everything is running okay, I ask it to update documentation in the repo and tag the release.

I use opencode that connects to a llama.cpp service. opencode lets me gate the AI so that any elevated commands that it needs to run (e.g. sudo or ssh), I have to approve it. It cant just go around making changes without permission.

I use Gitlab for all configurations ans then I have a Gitlab runner in my K3S cluster so I can deploy locally for free

I deploy with ansible keys and install ssh with a keys-only config and only ansible access.

Then I run some standard installs and configs with ansible and all future updates to apt, apk and docker are done with one ansible playbook.

I don't include the ansible host itself in the automation, nor my workstation, just to prevent everything from being broken at once if something goes wrong.

Everything is in docker or a virtual machine that starts on boot. Docker containers are managed with Dockhand's web ui. Once a month I ssh and "sudo apt upgrade" but that's it.

I tried to use olivetin to avoid having to ssh but I ran into errors I haven't had time to investigate yet.

nixos, mostly. It has a very steep learning curve but if it breaks I’m just "whatever, rollback now, fix properly later".

I have a kubernetes cluster inside of Proxmox vm's, generally I write a deployment, commit it to a git repo and then use argocd to deploy it in the cluster.

This is not something I would advise to anyone but the clinically insane, but for me there is a certain zen in having everything in git like that. It's for me the only way I can manage the 60ish applications I run without it having a permanent spot in my brain.

Nothing wrong with good old ssh. My VMs are different enough that building and maintaining ansible playbooks or something similar would be a bigger task than actually doing it in the traditional way. Maybe I could benefit by building simple playbooks to populate user accounts, ssh keys, smtp relay settings and other common things, but I don't really set up new servers that often that it would justify spending time to set up tools for that.