Biggest issue I see is that these LLMs tend to repeat themselves after a surprisingly short number of times (unless they're sufficiently bloated like ChatGPT).

If you ask any of the users of Sillytavern or RisuAI they'll tell you that these things have a long tail of not being very creative.