Firstly, thank you for posting this, it's a great topic.
I'm sure many bdsmers--dominants, submissives, and switches (my variety) alike struggle with this sexual juxtaposition from time to time. It's almost like a Jekyll and Hide thing isn't it?
I think that if you were a true misogynistic, as others have said, then you'd have the urge to abuse women all the time, and this obviously isn't the case.
I can't ever really remember not having sexual thoughts/urges, and certainly I've known I was kinky from a very young age. It just took me a long time to put a label on it and realise it was perfectly ...ok, not necessarily normal, but certainly ok. Yes, it used to bother me terribly that I had such a perceived perversion but then, before that, it also used bother me that if I got married I'd have to sneak away from my husband to masturbate ... *gg* Yes, really.