▲ 1043 ▼ Hexadecimal (slrpnk.net) submitted 2 years ago by Track_Shovel@slrpnk.net to c/lemmyshitpost@lemmy.world 131 comments fedilink hide all child comments
[–] vvilld@lemmy.world 1 point 1 year ago (1 child) How? permalink fedilink source parent hideshow 2 child comments replies: [–] coldsideofyourpillow@lemmy.cafe 1 point 1 year ago (2 children) By running it locally. The local models don't have any censorship. permalink fedilink source parent hideshow 4 child comments replies: [–] Charlxmagne@lemmy.world 3 points 1 year ago They do by default but like I said it's open source so you can tweak it to not be. permalink fedilink source parent [–] vvilld@lemmy.world 1 point 1 year ago (1 child) I meant, how does one run it locally. I see a lot of people saying to just "run it locally" but for someone without a background in coding that doesn't really mean much. permalink fedilink source parent hideshow 2 child comments replies: [–] coldsideofyourpillow@lemmy.cafe 1 point 1 year ago* You don't need a background in coding at all. In fact, the spaces of machine learning and programming are almost completely seperate. Download Ollama. Depending on the power of your GPU, run one of the following commands: DeepSeek-R1-Distill-Qwen-1.5B: ollama run deepseek-r1:1.5b DeepSeek-R1-Distill-Qwen-7B: ollama run deepseek-r1:7b DeepSeek-R1-Distill-Llama-8B: ollama run deepseek-r1:8b DeepSeek-R1-Distill-Qwen-14B: ollama run deepseek-r1:14b DeepSeek-R1-Distill-Qwen-32B: ollama run deepseek-r1:32b DeepSeek-R1-Distill-Llama-70B: ollama run deepseek-r1:70b Bigger models means better output, but also longer generation times. permalink fedilink source parent
[–] coldsideofyourpillow@lemmy.cafe 1 point 1 year ago (2 children) By running it locally. The local models don't have any censorship. permalink fedilink source parent hideshow 4 child comments replies: [–] Charlxmagne@lemmy.world 3 points 1 year ago They do by default but like I said it's open source so you can tweak it to not be. permalink fedilink source parent [–] vvilld@lemmy.world 1 point 1 year ago (1 child) I meant, how does one run it locally. I see a lot of people saying to just "run it locally" but for someone without a background in coding that doesn't really mean much. permalink fedilink source parent hideshow 2 child comments replies: [–] coldsideofyourpillow@lemmy.cafe 1 point 1 year ago* You don't need a background in coding at all. In fact, the spaces of machine learning and programming are almost completely seperate. Download Ollama. Depending on the power of your GPU, run one of the following commands: DeepSeek-R1-Distill-Qwen-1.5B: ollama run deepseek-r1:1.5b DeepSeek-R1-Distill-Qwen-7B: ollama run deepseek-r1:7b DeepSeek-R1-Distill-Llama-8B: ollama run deepseek-r1:8b DeepSeek-R1-Distill-Qwen-14B: ollama run deepseek-r1:14b DeepSeek-R1-Distill-Qwen-32B: ollama run deepseek-r1:32b DeepSeek-R1-Distill-Llama-70B: ollama run deepseek-r1:70b Bigger models means better output, but also longer generation times. permalink fedilink source parent
[–] Charlxmagne@lemmy.world 3 points 1 year ago They do by default but like I said it's open source so you can tweak it to not be. permalink fedilink source parent
[–] vvilld@lemmy.world 1 point 1 year ago (1 child) I meant, how does one run it locally. I see a lot of people saying to just "run it locally" but for someone without a background in coding that doesn't really mean much. permalink fedilink source parent hideshow 2 child comments replies: [–] coldsideofyourpillow@lemmy.cafe 1 point 1 year ago* You don't need a background in coding at all. In fact, the spaces of machine learning and programming are almost completely seperate. Download Ollama. Depending on the power of your GPU, run one of the following commands: DeepSeek-R1-Distill-Qwen-1.5B: ollama run deepseek-r1:1.5b DeepSeek-R1-Distill-Qwen-7B: ollama run deepseek-r1:7b DeepSeek-R1-Distill-Llama-8B: ollama run deepseek-r1:8b DeepSeek-R1-Distill-Qwen-14B: ollama run deepseek-r1:14b DeepSeek-R1-Distill-Qwen-32B: ollama run deepseek-r1:32b DeepSeek-R1-Distill-Llama-70B: ollama run deepseek-r1:70b Bigger models means better output, but also longer generation times. permalink fedilink source parent
[–] coldsideofyourpillow@lemmy.cafe 1 point 1 year ago* You don't need a background in coding at all. In fact, the spaces of machine learning and programming are almost completely seperate. Download Ollama. Depending on the power of your GPU, run one of the following commands: DeepSeek-R1-Distill-Qwen-1.5B: ollama run deepseek-r1:1.5b DeepSeek-R1-Distill-Qwen-7B: ollama run deepseek-r1:7b DeepSeek-R1-Distill-Llama-8B: ollama run deepseek-r1:8b DeepSeek-R1-Distill-Qwen-14B: ollama run deepseek-r1:14b DeepSeek-R1-Distill-Qwen-32B: ollama run deepseek-r1:32b DeepSeek-R1-Distill-Llama-70B: ollama run deepseek-r1:70b Bigger models means better output, but also longer generation times. permalink fedilink source parent
