I always understood his opposition to be mainly about the fact they were targeting "the wrong people" and might eventually land on British shores.
Fighting nazis is obviously a good thing, I just wasn't aware people thought he was uniquely good because of that.
Again, I am not British, so my understanding of his motivations are filtered by the pond between us.