Huge difference between an idiot going "go kill yourself" and a "friend" saying "Don't tell your mom
she'll ruin your plans. Take those pills and show her you mean business. I believe in you! You can do it!"
I think a lot of people who aren't familiar with AI underestimate how realistic it can sound and how "empathetic" it can be. It's actually evil.