I’m pretty sure it only worked in their apps

Of course :(

They’ve supported it since 2015 and provide this extensive documentation:

My feedback:

“Control what's playing on Apple TV” includes "What did he say?" with no explanation of the rewind/temp CC feature. Also excludes shorter “what was that?” command. I want a massive table of all command permutations and their results.