By definition, SemVer is supposed to have meaning to end users. If you see the third number increase, no worries, it's just bugfixes.

If you see the second number increase, well, in theory no worries, it's just cool new features but doesn't break anything you were doing, whatever you were doing should keep on working as always, and you can explore the new features at your leisure.

The first number changes: beware, something you may be used to can change/go away so it's not necessarily a slam dunk to update that.

The problem is that many projects just call it SemVer when they just play with arbitrary numbers. I'll call it "Marketing Versioning".