Yes, it would bother me. Like a few other people have said before me I wan't to be the one and only that they dom.
But other play partners wouldn't bother me.