Unfortunately, they are used to that, via gish-gallop politics. If you don't respond, they play it up as capitulation. If you respond, they often move on.
The best (least worst) answer is a quick, concise counter, then ignore it. It gives enough ammo to shut their implications down, without wasting too much more time.