You seem to miss the point (at least as far as I'm concerned). I haven't been downvoted as far as I know and if I would have been, I wouldn't throw a tantrum about it.
But when someone claims things to be THAT way, when I see it otherwise, I reserve my rights to speak out.
If someone claims low-rated posts happening because they "have resorted to insulting other parties collectively in lieu of a proper argument", without even criticizing the same behavior on high-rated posts or even did to a degree the very same themselves without being downvoted, then yes I reserve my rights to speak.
And it absolutely doesn't matter if I'm on the "winning" or "loosing" side of the spectrum.
You can criticize me for all and everything I wrote here or on other boards. If I made a mistake and someone call me out on it, I admit it.
If however I don't see the mistake on my side, then yes I'll may counter. And that usually with arguments, not with insults or personal attacks (though I'm NOT claiming innocence here for me).
What certainly doesn't work (at least for me), is this part:
ShaolinsKunk: ... if someone is not lobbing valid criticisms at you, ignore them.
Why? Maybe you check back on those real people in history and what difference it would have made, when they followed your above advice.
And as the spineless being I (clearly) seem to be, I'd like to give you an advice too: never, ever claim to not take the people on a god damn internet forum not freakin' seriously. At least not this one - others gotten already low-rated for doing so - and it wasn't me. I lacked the spine to do so.