This is actually not that dissimilar from the argument for only allowing free male landowners to vote.

It's bad enough that people are statistically disenfranchised by things like gerrymandering and small states. I can't imagine what it would be like if you let the politicians actually disenfranchise people.