82
I finally got TruNas running an LLM on my AMD GPU!!!
(gotosocial.michaeldileo.org)
You missed an e
Because it doesn't feel real ๐
Edit: i thought you referred to TrueNas. I'm tired
I think you are still missing an e in the title.
Cool project though
Congrats!!
Thank you! This took so long to figure out
I bet! That's a lot of technical info to sort through, understand and create.
That's so cool!!
Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn't really possible. Now, smooth sailing.
this post was submitted on 26 Mar 2025
82 points (89.4% liked)
Selfhosted
60623 readers
1211 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
-
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 3 years ago
MODERATORS