32
My Ever-Changing Homelab (thelemmy.club)
submitted 3 months ago by to c/homelab@lemmy.ml
12 comments fedilink hide all child comments
 

35883581

I consolidated my setup a bit. This is my local LLM hosting server. I took a gamble on a Chinese NVLink SXM2 mezzanine board from ebay, it was surprisingly plug and play for my dual 16GB v100s ๐Ÿ˜‚. I'm also running a Tesla P40 that I repasted with liquid metal that sits at 24C idle ๐Ÿฅถ.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] 4 points 3 months ago (1 child)

Nice, dude. Love anyone who learns by doing.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [โ€“] [S] 3 points 3 months ago

    It's been a fascinating experience so far and I feel like I'm only touching the surface. I'm exploring some of the various memory harnesses to hook into Hermes Agent and see how it learns with extended use.

  • permalink
  • fedilink
  • source
  • parent