That's the point, laws and agreements are not rights and don't affect rights.

There’s no external referee that’s going to stop the game because “your rights are being violated”.

Yes, that's why they are called rights and not something else.