Something about how fancy French sounds, juxtaposed with how vulgar the insult is, that makes it stick.

Like a guy in a tuxedo, but with his junk out

In English it's more like a guy at Walmart in sweatpants with his junk out; not that shocking