you are viewing a single comment's thread
view the rest of the comments
[–] 9 points 8 hours ago* (5 children)

You wouldn't want him using a local model unless he was running some fancy rig that could run a high end frontier model. He might not have such a thing laying around. Using the best out there for something like this is how you help avoid bugs.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 14 points 7 hours ago (2 children)

    He gets paid more than enough to afford high end hardware.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 46 minutes ago*

    He definitely can afford it yes, but its still a big ask to want someone to spend 15-25k or whatever it would be (shits getting more expensive by the day) to use a tool that he can just do pay per use. The code is open source so its not like he'd be using a local llm to keep it private.

  • source
  • parent
  • [–] 1 point 29 minutes ago
    • AMD Ryzen Threadripper 9960X

    • GIGABYTE TRX50 AERO D Motherboard

    • Samsung SSD 9100 PRO 2TB SSD

    • Noctua NH-U14S TR5-SP6 Cooler

    • Intel Arc B580 GPU

    • Fractal Design Torrent E-ATX Case

    • Seasonic PRIME TX-1600 1600W 80+

    • Titanium PSU

    • ASUS ProArt Display PA32QCV 31.5" 6K

    • HDR Monitor

  • source
  • parent
  • [–] 6 points 7 hours ago (1 child)

    Honestly, his mind and the community is probably one of the best things out there at the moment. They live the Linux Kernel, while that thing he used does not think or understand anything. Eh, it would be better if they moved with care instead, as that is a good way to avoid bugs too. I don't have a lot of faith in gassed up LLMs.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 50 minutes ago*

    He's doing it though. So that's kind or moot. Fable is out there finding bugs in these things, so seems like if he is going to do it, using the thing that's already making it more secure by finding multiple exploits is the right choice of what to use.

  • source
  • parent