139
Do you host your own AI?
(aussie.zone)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 24 Jun 2026
139 points (81.2% liked)
Selfhosted
60409 readers
905 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 3 years ago
MODERATORS
When you run it, do you use unsloth's recommended settings for coding?
https://unsloth.ai/docs/models/qwen3.6
Also have preserve thinking on, it helps it stay consistent in multi turn work.
Which model version you're using can also affect results, usually unsloth's ones are good.
With all that said, it's of course a small model so it's not a super coder. The 27b is better (I'd guess 25-35% better), but of course still a small model so..
So it'll maybe not be good enough still, but should give it the chance to let it do the best it can :)
So - I setup that model according to the docs and gave it this prompt:
After 10 minutes it gave me code that didn't compile.
It took another 3 mins to fix the compile error and the output is not correct.
As I said - LLMs on 8Gig VRAM just aren't worth it.