Yes, that should work. Check out stable-diffusion-webui (automatic1111) and text-generation-webui (oobabooga). And grab the models from civitai (stable diffusion) and huggingface (llms like llama, vicuna, gpt-j, wizard, etc.).