They only care about the skull logo and that he kills people to solve his problems.

Granted, that's why most people casually like the punisher. They just insert whatever group they don't like into the receiving end and call it good.