you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 4 months ago* (1 child)

Yeah probably a better pi setup would be to create more granular agent types. I tried creating a worker powered by deepseek but found it wasn't really that good. Something like an agent team spec (use a technical product manager agent to coordinate modules, review the worker output, and to make necessary corrections) then you could use a frontier model to plan and issue work instructions to the TPM agent

Not sure if this would be more economical in practice but would be interesting to try

Long run I think you will always need the data centers to handle big training loads but we might go back to on-prem computing for enterprises to run frontier models. Or even edge nodes that have enough muscle that folks can subscribe to locally.

Something in your city you can sub to for $30 a month that lets you run any flagship open source model could be very compelling

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago

    Something in your city you can sub to for $30 a month that lets you run any flagship open source model could be very compelling

    The admins at db0 have some sort of AI service mesh running already so thats way more viable than you'd think.

  • source
  • parent