Not many, majority. Only a few dozens species are asshole, and a handful of it is basically hell spawn. I have wasp often making nest near my garden, 0 sting, mostly because i live in tropical zone and in an area where asshole wasp isn't everywhere. The only wasp attack i've experienced so far is when i'm 10, where a wasp landed on my belly and i panicked swap it away, got stung that way.

Majority of wasp hater come from area where asshole wasp is around.