If you are not happy, if you do not feel valued or appreciated or needed, then it is time to let go. It's hard, but it sounds to me like you already know you deserve better. So let go of him, so that you free yourself up to go look for "better".