1445
Cast it into the fire
(media.fedia.io)
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
What about the AI that I run on my local GPU that is using a model trained on open source and public works?
This is very cool. Any advice a simple software engineer (me) could follow to practice the same?
Install LM Studio
Tell LM Studio to download the Apertus model: https://en.wikipedia.org/wiki/Apertus_(LLM)
Bob's ur uncle.
stick to 8B models for video cards with 8GB VRAM.
Thanks! I've always wanted an uncle bob, too!