The Eliza creator got his secretary to try it out, and as she got into her conversation she asked if he could leave to give her some privacy.
https://www.youtube.com/watch?v=RMK9AphfLco
There was a longer video talking about that in the context of how humans engage socially but I can't find it right now.
ed: Oh, it was in the most recent John Oliver segment on AI chatbots