No, a lot of information about elections is actually public. Who you vote for is very secret, but your name, address, and the fact that you did or did not vote is often either public or available on request. This is important because if it was just a totally secret thing, there's not much stopping a corrupt election official from dumping as many fake ballots into the total as they like or filling out ballots for people that didn't show up.