That's what I say as well and not just to those sort of questions.

'I'm not gonna answer that since there's no upside to it regardless of what I say.'

It's my go to for unfair questions/questions my opinion doesn't matter in.