What about consistently downvoted decent comments? Voting is anonymous, which isn't bad. But if you got people to explain why they downvoted, then that would help.