878
Pull the plug already (thelemmy.club)
submitted 15 hours ago by to c/fuck_ai@lemmy.world
165 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 10 hours ago (2 children)

So is it time to spin up a local model on the ol 5070ti and set it for mayhem? Any tips?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 7 hours ago (1 child)

    Look into ollama and figure out which local model (likely from huggingface) that fits best for how much memory your graphics card has.

    You can use AI (maybe copilot free) to guide you through all this. You'll be a little better off having that 16GB of memory than I have with my 10GB. The gwen model might be a good place to start?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 4 hours ago

    Hell yea, thanks brother! The irony of having an LLM walk me through setting up a local instance is pretty great lol, surprised that didn't occur to me! I have tried in the past with comfyUI but was over my head immediately.

  • permalink
  • fedilink
  • source
  • parent