I prefer to leave the mouth ungagged. That way, it makes it easier to communicate with the person whom you are whipping, flogging, pouring hot wax on, etc.

Although, there have been times when I wish I had a gag, too.