How do you monitor your server containers, disks, load...?

Do you use an easy-to-use web interface? Do you do everything via SSH? Or maybe you've got a more complicated setup?

I want to change my setup and I'm looking for new ideas, I've been using Cockpit for some years and some of the plugins are really outdated (ZFS for example) and others are completely broken (docker-compose).

top 50 comments

sorted by: hot top controversial new old
[–] 51 points 2 years ago (8 children)

My own server? YOLO

At work? Grafana, KOBS, Victoria Metrics, Jaeger, OpsGenie, ...

  • source
  • hideshow 8 child comments
  • [–] 20 points 2 years ago (3 children)

    My own server? YOLO

    I can't figure out whether there's a monitoring tool called YOLO or you don't monitor anything.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 4 points 2 years ago (3 children)

    This is the first time I’ve heard of Victoria Metrics. It looks like it has a similar use case as Prometheus, is that correct? If so, what made you or your team choose one over the other?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 2 years ago (2 children)

    IIRC it had better performance than Prometheus. We also ditched Elasticsearch in favor of ClickHouse to keep up with log ingestion.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 48 points 2 years ago (3 children)

    My clients when they text me the server is down.

  • source
  • hideshow 3 child comments
  • [–] 21 points 2 years ago

    "Huh weird, I tried to use and it's not working. Welp, guess I better fix it..."

  • source
  • [–] 20 points 2 years ago (11 children)

    I'm a huge fan of Netdata, very configurable and monitors just about anything you could want. Great interface and alerts too - https://www.netdata.cloud/

  • source
  • hideshow 11 child comments
  • [–] [S] 6 points 2 years ago (4 children)

    I was looking for something free that I could host on my machine but thanks, I didn't know about it

  • source
  • parent
  • hideshow 4 child comments
  • [–] 8 points 2 years ago (2 children)

    Netdata is free and can be run standalone. Just install it and do not configure the cloud integration. You can see your dashboard on localhost:19999

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 2 years ago*

    As others stated, you can run and access the interface locally (or setup your own reverse proxy) for free. Their Cloud dashboard is also free for up to 5 nodes. They recently added a flat-rate "Homelab" plan as well, if you want to remove the limit. It's all quite usable for $0 otherwise though!

  • source
  • parent
  • [–] 12 points 2 years ago

    I just use homepage as my homepage :D

    I can see simple CPU/RAM/storage stats and got widgets for almost all services, one of them is portainer so I can see if any service is stopped (most of them are running in docker). Also few services send notification on error or update

    I know its not really a monitoring tool, but it works well enough for me

  • source
  • [–] 12 points 2 years ago* (4 children)

    Node exporter on hosts, OpenTelemetry collector to scrape metrics and collect logs, shipping them to Prometheus and Loki, visualising with Grafana.

    Day job is for an observability platform where we heavily encourage the use of (and also contribute) to the OpenTelemetry collector project, hence my use of it.

  • source
  • hideshow 4 child comments
  • [–] 3 points 2 years ago

    Try VictoriaMetrics. Basically the same feature set as Prometheus, but so much more resource friendly for homelab scale. I store some metrics for 12 months now, because it's easy.

  • source
  • parent
  • load more comments (1 reply)
    [–] 8 points 2 years ago

    Zabbix for agent / snmp based statistics.

    Uptime Kuma for up/down states with a webhook notification into Discord so I get instant alerts on my phone when one goes down.

  • source
  • [–] 7 points 2 years ago (2 children)

    How has nobody in this thread said check_mk yet?

    It's free, you host it yourself. It's built off of nagios, compatible with nagios plugins, supports snmp or agent based checks. It can email, SMS, slack or discord you when something breaks, you can write your own custom checks in any language that can output to a local console... I could never imagine even looking for something else.

  • source
  • hideshow 2 child comments
  • load more comments (1 reply)
    [–] 5 points 2 years ago (1 child)

    I like monit. It’s simple to setup and pretty flexible.

    https://mmonit.com/monit/

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 5 points 2 years ago* (2 children)

    I've been using uptime Kuma recently and it's great but works better outside of docker.

    Inside docker I'd get a lot of false down positives from I assume docker throttling the checks.

    Plus it works with email, telegram, and matrix chat alerts. I monitor all my clients sites with it, and it's bullet proof behind caddy.

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 4 points 2 years ago

    At home, nagios, at work colleagues. (I finally escaped the admin rat race)

  • source
  • [–] 4 points 2 years ago

    At home, libreNMS. Just SNMP everything.

    For work, whatever the tool of the day is from management.

  • source
  • [–] 4 points 2 years ago* (3 children)

    Grafana set up to run on the server locally, then I connect to it via SSH forwarding. Then I can view all kinds of metrics in my browser in a neat interface.

  • source
  • hideshow 3 child comments
  • [–] [S] 2 points 2 years ago (2 children)

    I liked Grafana a lot, but I can't monitor things like zfs pools with it right?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 2 years ago (2 children)
  • load more comments (1 reply)
    [–] 4 points 2 years ago

    Prometheus and Altertmanager

  • source
  • [+] 3 points 2 years ago* (last edited 2 years ago) (1 child)
    load more comments (1 reply)
    [+] 3 points 2 years ago* (last edited 1 year ago)
    [–] 2 points 2 years ago* (last edited 2 years ago)

    Btop and logwatch with logrotate. I use healthchecks to check if the server is unreachable and it notifies me.

  • source
  • [–] 1 point 2 years ago

    I use collectd and graphs on my openwrt router. It can even use data from mqtt-connected thermometers and gather metrics from other collectd instances.

  • source
  • [–] 1 point 2 years ago

    Grafana, fronting information from Prometheus, Loki and Telegraf/influxdb since I'm used to that from work and has been a bit more set and forget compared to node_exporter. Easier to add in plugins as well instead of a new container/service to scrape.

  • source
  • load more comments
    view more: next ›