I can imagine some government prompting an LLM to break into some other governments system to steal state secrets.

”Here are the files you were after. Btw, I also stumbled across the nuclear launch codes, which I’ve confirmed are working. Was I a good machine? :3”