I don't mind silk, depending what's made of it and what's being done with it.
But the reality is, BDSM isn't really about clothing. I have a leather vest that I like to wear when we're out on the scene, and sometimes to play in as well- but I don't use it all or even most of the time, and I don't feel any less dominant because of it.