If he knows it is an issue of your health, it is likely he will readily accept it.

If he doesn't, then there are factors you are unaware of and need to know. Ask him and figure out what you can do to help him... but I wouldn't risk my life were I you. It would be unfair to all, especially your current child.