ByteDance just dopped Doubao-1.5-pro tht uses sparse MoE architecture, it matches GPT 4o benchmarks while being 50x cheaper to run, and it's 5x cheaper than DeepSeek (www.aibase.com)

submitted 1 year ago by yogthos@lemmygrad.ml to c/technology@lemmygrad.ml

23 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] yogthos@lemmygrad.ml 2 points 1 year ago

I got deepseek-r1:14b-qwen-distill-fp16 running locally with 32gb ram and a GPU, but yeah you do need a fairly beefy machine to run even medium sized models.

permalink
fedilink
source
parent

this post was submitted on 24 Jan 2025

44 points (97.8% liked)

Technology

1426 readers

141 users here now

A tech news sub for communists

founded 3 years ago

MODERATORS

muad_dibber@lemmygrad.ml

burlemarx@lemmygrad.ml

egs81t@lemmygrad.ml