But if it’s anonymous how do they know you didn’t do it?

That's why they ask for your name and address at the start - it's to verify that you have completed the census. Thar section is not tied to the actual census questions that come afterwards.