It's just a pungent salty umami flavour. Like miso, doenjanj, or furu.
Some people have palates that enjoy intense flavours, some people prefer mild flavours. It's not better or worse than anything else one might add to a dish or spread on bread to accompany breakfast.
I prefer the flavour of furu personally, although the texture and smell are intense enough that vegemite often becomes the default by convenience.
As australia has no culture people just get up in arms about the little things. You could read about schismogenisis if you wanted a broader overview of how similar peoples amplify little things to differentiate themselves.