Look into ollama and figure out which local model (likely from huggingface) that fits best for how much memory your graphics card has.

You can use AI (maybe copilot free) to guide you through all this. You'll be a little better off having that 16GB of memory than I have with my 10GB. The gwen model might be a good place to start?