you are viewing a single comment's thread
view the rest of the comments
[–] 80 points 4 months ago* (11 children)

Yes. That’s what I’ve been saying for a while. Without VC money to subsidize it, AI is fucking expensive. Literally the only reason anyone is paying for it is because it’s so cheap it’s barely worth it. Once the price goes up 10x, nobody’s gonna be interested.

  • source
  • hideshow 11 child comments
  • [–] 3 points 4 months ago (2 children)
  • [–] 2 points 4 months ago (7 children)

    Price per intelligence benchmark has been going down though but openai killed 4o mini which was the absolute cheapest smartish model.

    The writing is not on the wall just yet, but with some players dropping out and some enshittification I could see models becoming very expensive.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 5 points 4 months ago (5 children)

    I mean eventually open weight models will be good enough to do the few things AI is actually good at, and then there’s another reason to not pay astronomical prices.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 4 months ago

    I switched las month from GPT-OSS-120B to Gemma4 31B. For some simple scripts I found the latter considerably mor efficient, less verbose and with better results. At the same time the sycophancy is much worse.

    No way I'll use cloud based models and feed the data base. But also local models clearly like to burn energy.

  • source
  • parent
  • [–] 2 points 4 months ago (3 children)

    What's your use case? To me, lazy api doc search, and grammar/flow check

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 4 months ago

    I don't know shit about fuck when it comes to servers and networking, so my use case is a self hosting assistant, help me understand proxmox, write yaml, maintain documentation, configure .arr stack etc.

  • source
  • parent
  • [–] 2 points 4 months ago* (1 child)

    I don’t use AI for anything.

    Oh wait. I have started using it for something. I use it to look over contracts as a first pass and ask it to point out any red flags. I still read the contracts, but it can help find obvious unacceptable terms.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 4 months ago

    But the benchmarks are semi useless. Performance at new problems in your precise use case matter and that's only something one can find out you using it. This can differ wildly from what benchmarks suggest. AI can be an ability enhancer when for example someone who has no idea hos to code suddenly manages to create crappy code but that manages to do a job where for example success can be easily verified. But if the result should ve good or even reliable ... well....

  • source
  • parent