I was so sure your town was doing something unconstitutional because it sounded so blatantly wrong. Found the answer and man, your state needs to sort that shit out.
Fwiw, a few MA towns are going the other way: pushing the state to allow noncitizens to vote in TM.