this post was submitted on 31 Jan 2025
241 points (87.5% liked)
Technology
61300 readers
2561 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
What are the minimum system requirements to run something like deepseek on your own computer in some kind of firewall container?
There are plenty of ways and they are all safe. Don't think of DeepSeek as anything more than a (extremely large, like bigger than a AAA) videogame. It does take resources, e.g disk space and RAM and GPU VRAM (if you have some) but you can use "just" the weights and thus the executable might come from another project, an open-source one that will not "phone home" (assuming that's your worry).
I detail this kind of things and more in https://fabien.benetou.fr/Content/SelfHostingArtificialIntelligence but to be more pragmatic I'd recommend
ollama
which supports https://ollama.com/library/deepseek-r1So, assuming you have a relatively entry level computer you can install
ollama
thenollama run deepseek-r1:1.5b
and try.FWIW I did just try
deepseek-r1:1.5b
(the smallest model available viaollama
today) and ... not bad at all for 1.1Gb!It's still AI BS generating slop without "thinking" at all ... but from the few tests I ran, it might be one of the "least worst" smaller model I tried.
We're running it at work on a Mac mini with 64GB RAM (48GB for the GPU), and while it's a little slow, it works fine.