-4

FitMyLLM — Independent benchmarks for self-hosted AI (www.fitmyllm.com)

submitted 18 hours ago by anzo@programming.dev to c/homelab@programming.dev

5 comments fedilink hide all child comments

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

you are viewing a single comment's thread
view the rest of the comments

[-] ComradePenguin@lemmy.ml 1 points 10 hours ago

Interesting, I just have 8GB VRAM unfortunately. So can't run anything particularily useful for mye purpose 😔 The Gemma 4 E4B is quite good, but id like to run the 31B one

this post was submitted on 03 Jun 2026

-4 points (40.0% liked)

HomeLab

209 readers

22 users here now

A homelab is a server or multiple server setup that resides in your home and where you host sevelra applications and virtualized systems for testing and developing

Its a sandbox environment where you can experience and break and fix things in with no repercussions while its down

This is a community where you can share, discuss, or post news relating to homelabs

founded 2 years ago

MODERATORS

anzo@programming.dev