403
you are viewing a single comment's thread
view the rest of the comments
[-] Vlyn@lemmy.zip 5 points 1 day ago

You have 170+ GB VRAM at home? (:

I mainly use DeepSeek v4 Flash now, it's the cheapest around and the quality is high enough for coding. At work we're throwing tons of money at Claude, but even there I usually stick to Sonnet (as Opus is burning money).

[-] de_lancre@lemmy.world 1 points 1 day ago* (last edited 12 hours ago)

You don't need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don't get me wrong, but it still somewhat useable.

Upd.Once again, for those who use AI because struggles to read: it is slow, but it is usable. Which is, by definition, means that you don't need 170+ GB of VRAM to run this model. Period. It runs from ssd. That is a fact.

[-] placebo@lemmy.zip 1 points 16 hours ago* (last edited 16 hours ago)

"Somewhat" is doing a lot of heavy lifting there ๐Ÿ˜‚ How much time does it take to process your average request?

[-] dil@lemmy.zip 0 points 12 hours ago

1 token/second isn't remotely acceptsble lol

this post was submitted on 17 Jun 2026
403 points (98.8% liked)

Technology

85540 readers
3711 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS