417
ChatGPT's market share slips below 50% for first time (techcrunch.com)
submitted 2 months ago by to c/technology@lemmy.world
81 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 2 months ago (3 children)

Yeah the open weight models are getting good enough that a lot of people can just host their own for most tasks.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 2 months ago (2 children)

    On what hardware? I have a 1yo laptop running Linux and it's slow AF on open source llms. Might be to do with video card drivers, but I'd be happy to hear suggestions on which machine to put next to my raspberry pi for a local LLM.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 11 points 2 months ago

    You don't really want to be running them on a laptop. You either need a big dedicate graphics card (with 16 GB of RAM preferably) or a unified RAM/VRAM machine like a mac mini or a strix halo.

    Local model running is definitely more doable now that it was a year ago but its not yet at the level of throw it on anything and it'll work fine.

  • permalink
  • fedilink
  • source
  • parent