The concept is patently fallacious to anyone with a passing understanding of how this technology works. They are machines that execute instructions with no capacity to do anything else. Boeing autopilot capability didn't "escape containment" when it caused all those fatal crashes, because autopilot avionic capabilities do not actually fly the aircraft by understanding cause and effect, they execute "Open Relay B when Sensor A registers 18.6 volts until Sensor A registers 18.4 volts". The aircraft doesn't understand that Relay B opens the hydraulic servo controlling the elevator and that Sensor A is a pitot tube measuring angle of attack. LLMs just generate statistically likely text.