I believe downvoting is only available to users with high karma. This makes me believe that downvoting is meant to fight misbehavior. Unfortunately there is no way to report misbehavior of downvoting. If you already have high karma you have a conflict of interest in reporting downvoting misbehavior.
Maybe I have misused downvoting here. Can't downvoting be used to express disagreement instead of just reporting a misbehaviour?