32
My Ever-Changing Homelab (thelemmy.club)
submitted 3 months ago by to c/homelab@lemmy.ml
12 comments fedilink hide all child comments
 

35883581

I consolidated my setup a bit. This is my local LLM hosting server. I took a gamble on a Chinese NVLink SXM2 mezzanine board from ebay, it was surprisingly plug and play for my dual 16GB v100s 😂. I'm also running a Tesla P40 that I repasted with liquid metal that sits at 24C idle 🥶.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 3 points 3 months ago

It's been a fascinating experience so far and I feel like I'm only touching the surface. I'm exploring some of the various memory harnesses to hook into Hermes Agent and see how it learns with extended use.

  • permalink
  • fedilink
  • source
  • parent