you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 1 month ago

I run a Qwen 3.8 27b at home on gaming hardware. Got it scraping and posting news articles and general stupid questions. Takes 5 minutes instead of seconds because it has a gemma model doing RAG in the back end.

Other than some coding, I really don't have a reason to use a big model.

  • source
  • parent