▲ 11 ▼ Do you run locally? (lemmy.world) submitted 3 years ago by namelivia@lemmy.world to c/stablediffusion@lemmy.ml 14 comments fedilink hide all child comments I was curious, do you run Stable Diffusion locally? On someone else's server? What kind of computer do you need to run SD locally?
[–] IanM32@lemmy.world 5 points 3 years ago (1 child) I run it locally. I prefer having the most control I can over the install, what extensions I want to use, etc. The most important thing to run it in my opinion is VRAM. The more the better, as much as you can get. permalink fedilink source hideshow 2 child comments replies: [–] korewa@reddthat.com 2 points 3 years ago (2 children) I run locally too. I have a 10gb 3080. I haven’t had vram issues could you elaborate on your statement? I know on local llama I have been limited to 13b models permalink fedilink source parent hideshow 4 child comments replies: [–] IanM32@lemmy.world 2 points 3 years ago Stable Diffusion loves VRAM. The larger and more complex the images you're trying to produce, the more it'll eat. My line of thinking is that if you have a slower GPU it'll generate slower, sure, but if you run out of VRAM it'll straight up fail and shout at you. I'm not an expert in this field though, so grain of salt, YMMV, all that. permalink fedilink source parent [–] lloram239@feddit.de 1 point 3 years ago I know on local llama I have been limited to 13b models You can run llama.cpp on the CPU with reasonable speeds making full use of normal RAM to run much larger models. As for 10GB in SD, I run into lack of VRAM quite constantly when overdoing it, e.g. 1024x768 with multiple ControlNets and some other stuff is pretty much guaranteed to overflow it. I have to reduce the resolution when making use of ControlNet. Dreambooth training didn't even work at all for me due to lack of VRAM (might be possible to work around, but at least the defaults weren't usable). 10GB is still very much usable with SD, but one has to be aware of the limitations. The new SDXL will also increase the VRAM requirements a good bit. permalink fedilink source parent
[–] korewa@reddthat.com 2 points 3 years ago (2 children) I run locally too. I have a 10gb 3080. I haven’t had vram issues could you elaborate on your statement? I know on local llama I have been limited to 13b models permalink fedilink source parent hideshow 4 child comments replies: [–] IanM32@lemmy.world 2 points 3 years ago Stable Diffusion loves VRAM. The larger and more complex the images you're trying to produce, the more it'll eat. My line of thinking is that if you have a slower GPU it'll generate slower, sure, but if you run out of VRAM it'll straight up fail and shout at you. I'm not an expert in this field though, so grain of salt, YMMV, all that. permalink fedilink source parent [–] lloram239@feddit.de 1 point 3 years ago I know on local llama I have been limited to 13b models You can run llama.cpp on the CPU with reasonable speeds making full use of normal RAM to run much larger models. As for 10GB in SD, I run into lack of VRAM quite constantly when overdoing it, e.g. 1024x768 with multiple ControlNets and some other stuff is pretty much guaranteed to overflow it. I have to reduce the resolution when making use of ControlNet. Dreambooth training didn't even work at all for me due to lack of VRAM (might be possible to work around, but at least the defaults weren't usable). 10GB is still very much usable with SD, but one has to be aware of the limitations. The new SDXL will also increase the VRAM requirements a good bit. permalink fedilink source parent
[–] IanM32@lemmy.world 2 points 3 years ago Stable Diffusion loves VRAM. The larger and more complex the images you're trying to produce, the more it'll eat. My line of thinking is that if you have a slower GPU it'll generate slower, sure, but if you run out of VRAM it'll straight up fail and shout at you. I'm not an expert in this field though, so grain of salt, YMMV, all that. permalink fedilink source parent
[–] lloram239@feddit.de 1 point 3 years ago I know on local llama I have been limited to 13b models You can run llama.cpp on the CPU with reasonable speeds making full use of normal RAM to run much larger models. As for 10GB in SD, I run into lack of VRAM quite constantly when overdoing it, e.g. 1024x768 with multiple ControlNets and some other stuff is pretty much guaranteed to overflow it. I have to reduce the resolution when making use of ControlNet. Dreambooth training didn't even work at all for me due to lack of VRAM (might be possible to work around, but at least the defaults weren't usable). 10GB is still very much usable with SD, but one has to be aware of the limitations. The new SDXL will also increase the VRAM requirements a good bit. permalink fedilink source parent