Its easy to make slips like this in non scene groups... I do it all the time but in my 'public life' it is less of a problem as most of my friends are fairly liberal and come from a rock/goth background where the fetish scene is heavily represented anyway.
The main way I risk outing myself is in conversations about unsual sex practises. At one such conversation, one of the more conservative members of the group was mentioning something (not BDSM but linked with homosexual/transexual stuff) which he claimed was shocking. Most of the people there were indeed shocked. I shrugged and said, 'thats not so shocking' before realising that from their perspective it was very shocking.