My Hubby has a definite liking for the glow of pregnancy, he used to joke about keeping me barefoot and pregnant.
tessa is correct in telling you that there is no way for your swimmers to get anywhere the baby, the cervix is sealed and baby is safely sealed in its amniotic sac.
If it eases your mind at all sex during pregnancy is also very good for Mum for several reasons.