189
Do not use ai (thelemmy.club)
submitted 7 hours ago by to c/programmer_humor@programming.dev
48 comments fedilink hide all child comments
 

cross-posted from: https://piefed.zip/c/politicalmemes@lemmy.world/p/1758477/using-fascist-technology-to-fight-fascism-still-promotes-fascist-technology

Using fascist technology to fight fascism still promotes fascist technology.

you are viewing a single comment's thread
view the rest of the comments
[–] -1 points 4 hours ago (1 child)

If you want something useable you need a decent amount of RAM/VRAM and a modern GPU, things that aren't exactly accessible these days. That Kimi model is apparently half a terabyte in size and requires 100s of GB of VRAM, so I don't know why you're saying it's a 'local' model.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 4 hours ago (1 child)

    That is patently untrue. You can have useful ai on a esp32, a $10 chip. https://github.com/slvDev/esp32-ai It will not be as capable as kimi k3 in general generic tasks but you can fine tune models for certain workflows (literally how "distillation" works) and you can run them on affordable and available hardware. Just because you don't understand a tool or how to properly use it does not mean someone else doesn't.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 4 hours ago (1 child)

    Just because you don’t understand a tool or how to properly use it does not mean someone else doesn’t.

    You brought up the Kimi model up in a conversation about local models being viable, something that requires 8 Nvidia GB300s as a prerequisite. And I'm sorry I don't follow you're little hobby close enough for you, I did try it and it sucked.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 4 hours ago* (1 child)

    Kimi k3 can be ran at a cost of $37,900 with Mac studios. It's not a hobby. Cool, glad for you. Tools are tools, I bet you don't own or like an absolute gob of them but it doesn't change their usefulness, and you don't need kimi k3 for everything, I mentioned it specifically because it's comparable to generalized frontier ai models and can be ran locally, but I also stated that you're better off tuning models for your workloads specifically. Jfc why even comment if you're gonna be so dumb and selective with your reading?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 hours ago (1 child)

    I bet you don’t own or like an absolute gob of them but it doesn’t change their usefulness

    I was commenting based on my experience with this stuff, it was a lot of work to set up and the results I got were bad. I never even contended that it could be useful (but I'm reading selectively), I said you that you need decent hardware for it to be useable. I have an RX 6800 XT and 32GB of RAM and it was really slow, even with recommended models.

    Jfc why even comment if you’re gonna be so dumb and selective with your reading?

    I tried to engage in good faith, and you proceeded to call me an idiot, sorry I reacted poorly to you being rude. You get what you put in.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] -1 points 3 hours ago (1 child)

    Nah brother I'm not even going to continue giving you my time. You called my science and field a hobby, you questioned my reasoning when it was already presented, and you did not approach in good faith, you approached with preconceived notions, prejudice, and shit opinions based on your bad configs. I don't owe you shit.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •