It's not reasonable to put all of the divisiveness on conservatives, especially in the middle of an election where it's been said, repeatedly, that "only a racist will vote for McCain".
I totally agree that there are assholes of all stripes out there and that politics seems to bring that out, so I'm also sure that this has been said as well, but I'm pretty sure it's not a mainstream comment.