the keys are stored on the TPM and can't be exported
Makes sense; if you can export them, so can an adversary.
now the adversary demands access to your backups
Only if they know/think they exist. The idea here would have been to make a nondescript offline backup of the keys and keep them totally seprate from the rest of your data/belongings. Possibly in a geocache type location.