If he's stepping back because he now views you as damaged goods, I'd be the one doing some serious reconsidering of my own. Harm him with your feelings?!? PUH-LEEZE!

Jus' sayin'.