“When I asked ChatGPT, it said that if I transferred stolen money to an account tied to my losses, and if I was then caught for theft, police would naturally investigate the fraud along with the theft.”

One thing I've noticed is that AI in general expresses a delusional level of trust in established authorities.