As someone who has known you a very long time (is your voice still as sexy??) You are who you are.
There is nothing wrong with you not being comfortable giving tasks to same sex just as it is not wrong for those who are comfortable with it. You have to do what feels right for you.
My experience is that there is no absolute right or wrong in this lifestyle (as long as it is mutually consensual) no matter what others may try to say. Everyone is individual and has to be comfortable with the way THEY do things.
Over the past few years I have got to know many in the lifestyle, heterosexual, homosexual, bisexual, transgender, transexual, transvestite and enjoy the company of all of them. They are who they are - individuals, non judgemental (mostly), and bloody good fun.
So I guess what I'm trying to say RD is - be your wonderful self as usual and don't worry about it.