I just use my washing machine as my dirty laundry basket. Take it off and not gonna wear it again? Toss it in the washer (or at least in a pile vaguely in front of the washing machine until I get around to actually putting them in.....)
Though, I have also ruined many towels this way because apparently zippers and stuff tend to want to rip out the looped fibers on them.