I think the German saying „Der Ton macht die Musik.“ fits very well here. There is a massive difference between you bringing it up as an conversation starter and an incel jerk using it as a challenge.