146
Finally escaping Windows, ironically thanks to AI (lemmy.world)
submitted 20 hours ago by to c/selfhosted@lemmy.world
56 comments fedilink hide all child comments
 

I've had several occasions in my life where I've tried to switch to Linux only to run into hardware incompatibilities that would have taken me man-months to solve. Thanks to GPT my primary personal PC, home media and project server is now running Linux and fully functional. I've got Jellyfin, NextCloud, Navidrome and Joplin all happy. I've also been able to wipe an obsolete MacOS off my 2017-era Macbook Pro and it's happily running Mint.

There's a deep irony in Windows being enshittified by AI, while the same AI makes Linux about a billion times more usable. Now I have a leftover Windows micro-PC running a local LLM model, so I can be less dependent on GPT, as long as time isn't a factor...

you are viewing a single comment's thread
view the rest of the comments
[–] 11 points 17 hours ago (7 children)

Now I have a leftover Windows micro-PC running a local LLM model, so I can be less dependent on GPT, as long as time isn't a factor...

Might as well go all in. LM Studio, Stability Matrix, Comfy UI, Ollama - everything's native on Linux.

  • permalink
  • fedilink
  • source
  • hideshow 7 child comments
    •
  • [–] 2 points 14 hours ago (6 children)

    (i personally haven't ever used llms personally but) i've heard many negative things about ollama from the localllama comm, may be worth searching before using it

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 2 points 14 hours ago

    Yes, well, my use for Ollama is solely as a plugin for Home Assistant. But you can wrap llama.cpp with whatever you want or use the half-dozen semi-popular competitors! My point is just that there are no tools that are exclusive to Windows, they're all on Linux.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 14 hours ago (3 children)

    I've had zero issues with ollama, and every day I get closer to no longer using the frontier models.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 14 hours ago (2 children)

    found this from my bookmarks

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 14 hours ago* (last edited 4 hours ago) (1 child)

    That article is dated, and a lot of the new improvements specifically offset a lot of the claims being made there which just looking at the tone seem to be more of a hit piece on ollama then an objective look to compare. While llama.cpp does have some minor benefits, a lot of the testing I've seen and done shows that they are minimal.

    For me at least olama is easy to use, simple to set up, and gets the job done. People can use other tools that's fine, but as I said, I've been using it with no issue for a while now, and when I've looked at switching it just doesn't make any sense.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •