I mean ChatGPT was already very easily influenced by just stating a username of a heavy user of r/counting.

It's been patched out by now, but it was very funny.