What the example shows is that you cannot "teach" the llm how to count the letter R, because LLMs don't work that way.
The AI company would have to solve the problem another way, let's say by recognizing that the user is asking for letter-counting, and pass that off to a different kind of algorithm that can count letters.