As a southern girl, I'm quite comfortable with Sir or Ma'am. Add that to being an army brat and they just naturally fall from my lips.
I actually prefer that form of address from my girl but, must confess, I do get a shiver sometimes when she uses Mistress.
I don't like when anyone who doesn't know me uses Mistress, though.