139
Do you host your own AI? (aussie.zone)
submitted 1 week ago by SuspiciousCarrot78@aussie.zone to c/selfhosted@lemmy.world
204 comments fedilink hide all child comments

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[-] atzanteol@sh.itjust.works 1 points 3 days ago

So - I setup that model according to the docs and gave it this prompt:

Write me a highly optimized n-queens solver in go. It should take advantage of parallelism (what little there is) and output only the solution and how long it took.

After 10 minutes it gave me code that didn't compile.

It took another 3 mins to fix the compile error and the output is not correct.

As I said - LLMs on 8Gig VRAM just aren't worth it.

this post was submitted on 24 Jun 2026
139 points (81.2% liked)

Selfhosted

60409 readers
246 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
ayyy@sh.itjust.works
curbstickle@anarchist.nexus
curbstickle_lw@lemmy.world