263
Do not use ai (thelemmy.club)
submitted 11 hours ago by to c/programmer_humor@programming.dev
59 comments fedilink hide all child comments
 

cross-posted from: https://piefed.zip/c/politicalmemes@lemmy.world/p/1758477/using-fascist-technology-to-fight-fascism-still-promotes-fascist-technology

Using fascist technology to fight fascism still promotes fascist technology.

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 9 hours ago (4 children)

You cannot run it locally and have the same thing that oligarchs and big-tech have at their disposal.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 8 points 9 hours ago (1 child)

    You literally can. Kimi k3 is fist for fist punching at both sol and fable levels. The smaller qwen 3.8 27b is benching well against gpt 5.4 and opus 4.7. There are unreleased internal models you cannot run locally but you also can't buy them. Additionally, big models are generally bad tools, you're much better off tuning a local model for your specific task (Wendel from level 1 has a good video on this). If you're gonna make claims at least do a Google search.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 8 hours ago (1 child)

    If you want something useable you need a decent amount of RAM/VRAM and a modern GPU, things that aren't exactly accessible these days. That Kimi model is apparently half a terabyte in size and requires 100s of GB of VRAM, so I don't know why you're saying it's a 'local' model.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 8 hours ago (1 child)

    That is patently untrue. You can have useful ai on a esp32, a $10 chip. https://github.com/slvDev/esp32-ai It will not be as capable as kimi k3 in general generic tasks but you can fine tune models for certain workflows (literally how "distillation" works) and you can run them on affordable and available hardware. Just because you don't understand a tool or how to properly use it does not mean someone else doesn't.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 8 hours ago (1 child)

    Just because you don’t understand a tool or how to properly use it does not mean someone else doesn’t.

    You brought up the Kimi model up in a conversation about local models being viable, something that requires 8 Nvidia GB300s as a prerequisite. And I'm sorry I don't follow you're little hobby close enough for you, I did try it and it sucked.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 8 hours ago* (1 child)

    Kimi k3 can be ran at a cost of $37,900 with Mac studios. It's not a hobby. Cool, glad for you. Tools are tools, I bet you don't own or like an absolute gob of them but it doesn't change their usefulness, and you don't need kimi k3 for everything, I mentioned it specifically because it's comparable to generalized frontier ai models and can be ran locally, but I also stated that you're better off tuning models for your workloads specifically. Jfc why even comment if you're gonna be so dumb and selective with your reading?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 7 hours ago (1 child)

    I bet you don’t own or like an absolute gob of them but it doesn’t change their usefulness

    I was commenting based on my experience with this stuff, it was a lot of work to set up and the results I got were bad. I never even contended that it could be useful (but I'm reading selectively), I said you that you need decent hardware for it to be useable. I have an RX 6800 XT and 32GB of RAM and it was really slow, even with recommended models.

    Jfc why even comment if you’re gonna be so dumb and selective with your reading?

    I tried to engage in good faith, and you proceeded to call me an idiot, sorry I reacted poorly to you being rude. You get what you put in.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] -1 points 7 hours ago (1 child)

    Nah brother I'm not even going to continue giving you my time. You called my science and field a hobby, you questioned my reasoning when it was already presented, and you did not approach in good faith, you approached with preconceived notions, prejudice, and shit opinions based on your bad configs. I don't owe you shit.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 8 hours ago*

    There's also Colibri which runs large models off of a SSD at a much slower speed than corporations. The large high-quality stuff has been gated by big-tech with gigantic GPUs. Colibri, if nothing else than a proof of concept, shows that high quality stuff can run on anything with a hit to speed.

  • permalink
  • fedilink
  • source
  • parent