Is anyone actually surprised by this?

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 years ago (2 children)

If you have the hardware, then yes, you can.

  • source
  • parent
  • hideshow 2 child comments
  • [–] -1 points 2 years ago (1 child)

    Ah, just acquire such hardware, very simple and anyone can do it without supply chain knowledge or advantage

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 2 years ago*

    Sorry but you are just talking assumptions without even having looked at the facts.

    Its not cheap, but basically a single toptier gaming desktop with an additional graphics card (or 2) is literally all you need.

    I know multiple people who work normal IT jobs that have already started on setting up their own. They plan on running them for their whole family, many users at a time from the same machine.

    Here is someone who got it to work on a cluster of mac-minis. Again not cheap, but clearly within dedicated consumer enthusiast reach. https://digialps.com/deepseek-v3-on-m4-mac-blazing-fast-inference-on-apple-silicon/

    And this is before even considering how fast open source moves, i am expecting quantized models which can have double speed for negligible quality impact any second now.

  • source
  • parent