The minute a D is, on balance, worse than an R, I would vote against them (i.e. for the R).
If the Rs are enthusiastic about supporting genocide and the Ds are toying with going against it? I'll vote D.
If the Rs are enthusiastic about depriving minorities of their rights and the Ds are meekly speaking out against it? I'll vote D.
etc. etc.