Oh sweetie. I'm not going to give you any advice - you will decide what to do based on your own thoughts and feelings. But, if you choose to leave him, just know that he is not the only man who can be what you need and want.
I rarely give out 'online hugs' but here's one for you.
~big hug~
jeanne