I was thinking it would work like reddit, where you can set a threshold in your preferences and posts below that vote total will be hidden from you. The default was something like -5 iirc.
Every post would still start with your one vote.