146
Both Fedora and Ubuntu will get AI support – soon (www.theregister.com)
submitted 4 months ago by to c/technology@lemmy.world
65 comments fedilink hide all child comments
 

Both Ubuntu and Fedora have made it official: support is coming soon for running local generative AI instances.

An epic and still-growing thread in the Fedora forums states one of the goals for the next version: the Fedora AI Developer Desktop Objective. It is causing some discontent, and at least one Fedora contributor, SUSE’s Fernando Mancera, has resigned.

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 4 months ago (6 children)

FOMO is a thing. Who’s gonna want to run the old version packaged in the distro anyway. Those things go stale pretty quickly, especially at the rate we’re seeing updates in local inference.

  • permalink
  • fedilink
  • source
  • hideshow 6 child comments
    •
  • [–] 2 points 4 months ago (5 children)

    Afaik its only gonna be used for stuff like screen reading, which if you've ever tried an open source speech synthesis model, you'd know even an old lightweight LLM model is better than it.

    I'd also argue that if you actually care about local llms, you can just set up ollama and use that.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 2 points 4 months ago (4 children)

    I hope actual weights are not packaged as part of the OS. The inference engine, sure, but again, it’s gonna get stale really fast.

    Friends don’t let friends run Ollama. There are much better options.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 2 points 4 months ago (3 children)

    It's apparently a separate spin anyway, so your standard Fedora won't have any of that shipped with it.

    And it you're using Ubuntu, I really can't help you.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 4 months ago (2 children)

    That was a good burn. I know I can do better with my distro choice. :)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 4 months ago (1 child)

    Chin up, you could also do worse! Microslop are way ahead of Canonical or RedHat, and way less scrupulous about it...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •