you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 2 days ago (4 children)

Something that has a fixed up front cost to run*

Otherwise, YES!

  • source
  • parent
  • hideshow 4 child comments
  • [–] 6 points 2 days ago (2 children)

    Depending on your rig there will still be recurring cost (electricity)

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 2 days ago

    Maybe, maybe not. Phones are getting more optimized for AI and have decent RAM, so the on device models may not be great at agentic problem solving, but they'll probably meet most people's AI needs

    Plus, any reasonable gaming computer or MacBook can run models... Maybe a bit slowly and maybe just the compressed 8gb models, but they can pretty much all do it to some degree

    So I think we'll be in a place where there's little or no upfront cost after a couple more key advancements

  • source
  • parent