Plain rubber (or latex) isn't poisonous as far as I know, nor is the colouring used to get bright red, purple or whatever tint to the gag. It would be advisable to wash them of course, I wouldn't want to be silenced with something that feels smelly from being used by somebody else.