1938
The dream (lemmy.world)
you are viewing a single comment's thread
view the rest of the comments
[-] CeeBee@lemmy.world 2 points 2 years ago

I don't know of an LLM that works decently on personal hardware

Ollama with ollama-webui. Models like solar-10.7b and mistral-7b work nicely on local hardware. Solar 10.7b should work well on a card with 8GB of vram.

[-] ParetoOptimalDev@lemmy.today 1 points 2 years ago

If you have really low specs use the recently open sourced Microsoft Phi model.

this post was submitted on 25 Dec 2023
1938 points (97.9% liked)

People Twitter

10298 readers
576 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

  1. Mark NSFW content.
  2. No doxxing people.
  3. Must be a pic of the tweet or similar. No direct links to the tweet.
  4. No international politcs
  5. Be excellent to each other.
  6. Provide an archived link to the tweet (or similar) being shown if it's a major celebrity, figure or any politician. If you replace the "x" at their site with xcancel (so it beomes xcancel.com), and you're not on mobile, it will save video. https://web.archive.org/save is another great option. Archive.is is no longer recommended because they remove/alter content.
  7. If a tweet (or similar) makes a statement of fact, either mark it as "satire" in the body or provide the original source link backing up the statement

founded 3 years ago
MODERATORS