this post was submitted on 29 Jan 2025
1286 points (99.2% liked)

Microblog Memes

6330 readers
3345 users here now

A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.

Created as an evolution of White People Twitter and other tweet-capture subreddits.

Rules:

  1. Please put at least one word relevant to the post in the post title.
  2. Be nice.
  3. No advertising, brand promotion or guerilla marketing.
  4. Posters are encouraged to link to the toot or tweet etc in the description of posts.

Related communities:

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 1 day ago* (last edited 1 day ago)

Running the model can be no more taxing than playing a modern video game, except the load is not constant.

This is not true, Deepseek R1 is huge. There's a lot of confusion between the smaller distillations based on Qwen 2.5 (some that can run on consumer GPUs), and the "full" Deepseek R1 based on Deepseekv3

Your point mostly stands, but the "full" model is hundreds of gigabytes, and the paper mentioned something like a bank of 370 GPUs being optimal for hosting. It's very efficient because its only like 30B active, which is bonkers, but still.