As a (dominant) guy, I look at this from a different psychological perspective. If a woman is dressed up in distinctly sexual attire, it suggests she's looking for some attention in that area (even if she's really not). Subconsciously, it's natural for a male to assume this.

Now flip that logic around. If she's wearing normal, even slightly masculine clothing, the presumption of sexual interest isn't there. Maybe it's just me, but that tends to amplify the feeling of dominance resulting from any, we'll say, unsolicited behavior on my part.

Not that I'm in any way against lingerie and whatnot, but forcing a sub in "plain" clothes into some action feels much more spontaneous.