When prompts to draft work emails and job applications contain language commonly used by women, artificial intelligence chatbots including ChatGPT offer less sophisticated responses compared to office correspondence requested with language associated with men

Ok, we know that LLMs work basically as text completion and will adapt the language used in the response to the one used in the prompt. Their findings basically tell us that "language commonly used by women" is found in text content that is "less complex, at a lower grade level, and less formal". It's just statistics. To fix this "bias" they would have to artificially create loads of complex and formal text that uses "language commonly used by women" and use it to train LLMs. Not sure what the point of that would be though. If you want complex and formal response just write a complex and formal prompt.