256
IBM CEO says open weight models are now irresistibly good and cheap on-prem (www.theregister.com)
submitted 3 days ago* by to c/technology@lemmy.world
36 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 29 points 3 days ago* (last edited 3 days ago) (5 children)

Maybe I'm just sleep deprived, cynical, or thinking too deep into it, but I don't even like how they are using the words "on-prem" throughout the article instead of simply saying they're running local LLMs. Seems like such a weird choice of wording that is meant to subtly steer less informed people away from looking into alternatives to the subscription based LLM services, as most casual people wont associate it as the same thing and ignore it and move on. Even if that's the correct terminology for that specific field, I feel like most people would just naturally say "Yes, we are running the LLM servers locally here" as that's the only way I've ever heard people say it even online.

  • permalink
  • fedilink
  • source
  • hideshow 5 child comments
    •
  • [–] 67 points 3 days ago* (2 children)

    For a company "on-prem" might not mean the same as "local". You might run them in your company data center or in a colocated server (rented space in a data center). In either of those cases, the data center might be physically close to you, but it could be on a different continent.

    "On-prem" implies that the company has physical access/control of the server.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 22 points 3 days ago

    "On-premises" as it refers to enterprise hw/sw, has been a phrase much longer than "local LLM"

    Even though everyone moved to cloud, most companies keep some portion of their infrastructure on-prem, like prod env in the cloud and on-prem test env/backups, or vice versa

    Maybe most consumers wouldn't recognize the phrase, but industry professionals certainly would

  • permalink
  • fedilink
  • source
  • parent