you are viewing a single comment's thread
view the rest of the comments
[–] [S] 7 points 2 years ago* (1 child)

so you can run the good version at home! this thread tells how to build a workstation for it.

tl;dr 768GB RAM.

with that, you can run the largest deepseek model, or even open a tab in chrome

apparently it's not very fast, but it does in fact do the stuff

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 2 years ago

    ah, I stand corrected! the figures I was looking at previously were for doing it at acceptable speeds in a data center.

    can you imagine the intensity of the RGB in the boy genius Prompt Engineer’s new $6000 custom top end gaming PC with server components? maybe they’ll have the LLM slowly plagiarize them a Python script that turns on more RGB when the GPU’s under load.

  • source
  • parent