part and parcel of any relationship..nilla or otherwise...communication really is the key.
you need to try and sit down and talk to him...find out what is bothering him...was it something you have done yadda yadda yadda.
as others have said hre..it sounds all a bit fishy and you need to gt to the bottom of it

cg