sorted by: new top controversial old
Observability Stack? in c/selfhosted@lemmy.world
Observability Stack? in c/selfhosted@lemmy.world
Observability Stack? in c/selfhosted@lemmy.world
Observability Stack? in c/selfhosted@lemmy.world
[–] [S] 1 point 23 hours ago* (last edited 22 hours ago) (1 child)

Cool, sounds like a fun project.

Not sure if you have been looking into Jev or other System 1 models, but it might be a good fit since it can output a structured type-safe output. Most of the automation I've tried in the past with LLMs failed due to the output structure being hallucinated (ignoring my requested structure). But it sounds like System 1 models might fix that.

I've been looking at an open source model called Laya a little and it might work well for your project. Sounds like you'd want structured output.

What kind of rig do you have ollama running on?

  • permalink
  • fedilink
  • source
  • parent
  • context
    • 56
    Observability Stack? (lemmy.ca)
     

    I'm curious as to which tools and technologies you all are using to keep track of all those services you are deploying, whether it be resource tracking, network traffic, logs, traces, or uptime.

    As a bonus question, how have you organized your network or your services to reduce the overhead of implementing observability?