"On-premises" as it refers to enterprise hw/sw, has been a phrase much longer than "local LLM"

Even though everyone moved to cloud, most companies keep some portion of their infrastructure on-prem, like prod env in the cloud and on-prem test env/backups, or vice versa

Maybe most consumers wouldn't recognize the phrase, but industry professionals certainly would