this post was submitted on 31 Jan 2025
241 points (87.8% liked)
Technology
61300 readers
2523 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
There are plenty of ways and they are all safe. Don't think of DeepSeek as anything more than a (extremely large, like bigger than a AAA) videogame. It does take resources, e.g disk space and RAM and GPU VRAM (if you have some) but you can use "just" the weights and thus the executable might come from another project, an open-source one that will not "phone home" (assuming that's your worry).
I detail this kind of things and more in https://fabien.benetou.fr/Content/SelfHostingArtificialIntelligence but to be more pragmatic I'd recommend
ollama
which supports https://ollama.com/library/deepseek-r1So, assuming you have a relatively entry level computer you can install
ollama
thenollama run deepseek-r1:1.5b
and try.FWIW I did just try
deepseek-r1:1.5b
(the smallest model available viaollama
today) and ... not bad at all for 1.1Gb!It's still AI BS generating slop without "thinking" at all ... but from the few tests I ran, it might be one of the "least worst" smaller model I tried.