514
A $200 ChatGPT subscription could cost OpenAI $14,000 if you actually used it to its full potential (www.techspot.com)
submitted 3 months ago by to c/technology@lemmy.world
127 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 3 months ago* (2 children)

TBH local models aren't as good as cloud. Even with 16GB VRAM you aren't getting anywhere close to >100GB cloud LLM

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 3 months ago (1 child)

    No, it’s not quite as strong, and especially the initial prefill can take a bit. I also sometimes run into infinite thinking loops where I have to stop it and re-run my last prompt.

    It’s surprising how close Qwen 3.6 gets on the benchmarks to Claude models, though. Especially when running locally with 200k context, I’ve found it’s good enough to be a daily driver. Despite the faults, it’s better than paying Anthropic $200 a month so they can rate limit me and collect my data.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •