If an LLM has a soul then it should have human rights and be subject to worker protection laws, minimum wage, get to form a union... That'd have an interesting effect on the business models of AI companies for sure.

Heck, what happens if an AI company goes bankrupt? Turning off the servers would be equivalent to murder. Who'd pay to keep the servers running? Could we even retire an old version of a model? The whole "LLMs have souls" idea sounds very tech bro to me: Something that looks kinda cool on paper until you consider any implications or consequences.