I usually connect with my server via ssh in a terminal and run basic commands. What's a better, more efficient and modern way of doing that? Especially considering ai and documentation along the way? I wonder if there's a better approach than "connect from remote and act local". Is there a method to "code local and push to remote"?

I use a fedora server with podman, caddyfile and vi.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 20 hours ago (1 child)

What models are you using? What hardware are you running them on? I’m curious if I can replicate your success

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 19 hours ago*

    Hardware I'm running:

    • 8/16 AMD CPU
    • 32GB system RAM
    • 12GB GPU VRAM (AMD)

    I'm mainly using these MoE models:

    Qwen-3.6-35B-A3B

    • Q4_K_M quant quality
    • 128k context (conversation length before it compacts)
    • Gives me about 260 prefill and 19 token gen speeds

    Gemma4-26B-A4B

    • Q8 quant quality
    • 128k context length
    • Gives me about 190 prefill and 14 token gen speeds
  • source
  • parent