That is the wrong analogy. It's more like blaming the 70% of police officers who aren't responding to the school shooting happening 30ft away
They are both a problem. Neither is more real than the other. The shooter is evil, and the cops who watched the shooter walk into the school strapped with an AR-15, and have an obligation to do something about it but aren't, are negligent.
Now, I'll be clear: there are a LOT of things that disenfranchise voters, so it's not as simple as "everyone should always vote and if they don't they're bad". But we can still point at both problems at the same time.