Downvote buttons are meant to be used for comments that don't contribute to the discussion or are plainly completely wrong, not for opinions you disagree with. But most people can't stand being disagreed with on things they feel passionately about, so they will still downvote where they merely disagree.