It sometimes affects what I write, but not in a bad way. If I see a comment that I wrote has poor karma, or a critical response to a comment I wrote has high karma, I will often go back and flesh out my argument better.

At least on Hacker News, it seems to be a sign that my comment was poorly written rather than against popular wisdom.