▲ 190 ▼ Open-source Deepseek R1 dethrones commercial AI, now allegedly being hit by cyberattack (www.cnbc.com) submitted 2 years ago by JOMusic@lemmy.ml to c/world@lemmy.world 50 comments fedilink hide all child comments
[–] JustARaccoon@lemmy.world 6 points 2 years ago (1 child) You can get it from Ollama permalink fedilink source parent hideshow 2 child comments replies: [–] Rogue@feddit.uk 1 point 2 years ago* (1 child) Thanks Any recommendations for communities to learn more? Frustratingly Their setup guide is terrible. Eventually managed to get it running. Downloaded a model and only after it download did it inform me I didn't have enough RAM to run it. Something it could have known before the slow download process. Then discovered my GPU isn't supported. And running it on a CPU is painfully slow. I'm using an AMD 6700 XT and the minimum listed is 6800 https://github.com/ollama/ollama/blob/main/docs/gpu.md#amd-radeon permalink fedilink source parent hideshow 2 child comments replies: [–] JustARaccoon@lemmy.world 3 points 2 years ago* (1 child) If you're setting up from scratch I recommend using open webui, you can install it with GPU support onto docker/podman in a single command then you can quickly add any of the ollama models through its UI. permalink fedilink source parent hideshow 2 child comments replies: [–] Rogue@feddit.uk 0 points 2 years ago (1 child) Thanks, I did get both setup with Docker, my frustration was neither ollama or open-webui included instructions on how to setup both together. In my opinion setup instructions should guide you to a usable setup. It's a missed opportunity not to include a docker-compose.yml connecting the two. Is anyone really using ollama without a UI? permalink fedilink source parent hideshow 2 child comments replies: [–] JustARaccoon@lemmy.world 1 point 2 years ago* The link I posted has a command that sets them up together though, then you just go to https://localhost:3000/ permalink fedilink source parent
[–] Rogue@feddit.uk 1 point 2 years ago* (1 child) Thanks Any recommendations for communities to learn more? Frustratingly Their setup guide is terrible. Eventually managed to get it running. Downloaded a model and only after it download did it inform me I didn't have enough RAM to run it. Something it could have known before the slow download process. Then discovered my GPU isn't supported. And running it on a CPU is painfully slow. I'm using an AMD 6700 XT and the minimum listed is 6800 https://github.com/ollama/ollama/blob/main/docs/gpu.md#amd-radeon permalink fedilink source parent hideshow 2 child comments replies: [–] JustARaccoon@lemmy.world 3 points 2 years ago* (1 child) If you're setting up from scratch I recommend using open webui, you can install it with GPU support onto docker/podman in a single command then you can quickly add any of the ollama models through its UI. permalink fedilink source parent hideshow 2 child comments replies: [–] Rogue@feddit.uk 0 points 2 years ago (1 child) Thanks, I did get both setup with Docker, my frustration was neither ollama or open-webui included instructions on how to setup both together. In my opinion setup instructions should guide you to a usable setup. It's a missed opportunity not to include a docker-compose.yml connecting the two. Is anyone really using ollama without a UI? permalink fedilink source parent hideshow 2 child comments replies: [–] JustARaccoon@lemmy.world 1 point 2 years ago* The link I posted has a command that sets them up together though, then you just go to https://localhost:3000/ permalink fedilink source parent
[–] JustARaccoon@lemmy.world 3 points 2 years ago* (1 child) If you're setting up from scratch I recommend using open webui, you can install it with GPU support onto docker/podman in a single command then you can quickly add any of the ollama models through its UI. permalink fedilink source parent hideshow 2 child comments replies: [–] Rogue@feddit.uk 0 points 2 years ago (1 child) Thanks, I did get both setup with Docker, my frustration was neither ollama or open-webui included instructions on how to setup both together. In my opinion setup instructions should guide you to a usable setup. It's a missed opportunity not to include a docker-compose.yml connecting the two. Is anyone really using ollama without a UI? permalink fedilink source parent hideshow 2 child comments replies: [–] JustARaccoon@lemmy.world 1 point 2 years ago* The link I posted has a command that sets them up together though, then you just go to https://localhost:3000/ permalink fedilink source parent
[–] Rogue@feddit.uk 0 points 2 years ago (1 child) Thanks, I did get both setup with Docker, my frustration was neither ollama or open-webui included instructions on how to setup both together. In my opinion setup instructions should guide you to a usable setup. It's a missed opportunity not to include a docker-compose.yml connecting the two. Is anyone really using ollama without a UI? permalink fedilink source parent hideshow 2 child comments replies: [–] JustARaccoon@lemmy.world 1 point 2 years ago* The link I posted has a command that sets them up together though, then you just go to https://localhost:3000/ permalink fedilink source parent
[–] JustARaccoon@lemmy.world 1 point 2 years ago* The link I posted has a command that sets them up together though, then you just go to https://localhost:3000/ permalink fedilink source parent