I recommend Ollama, its easy to setup and the cli can download and run llms. With some more techsavviness you can get openwebui as a nice ui.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: