If wearing the collar makes you uncomfortable, then I would suggest you remove it. Show your boyfriend what made you decide this over how you previously felt. Let him know that the dynamic of your relationship just isn't what the collar represents to you.

When you do have that discussion, you will also probably discuss if your relationship is able to get to a D/s type that you seek. Evaluate now before you have that talk, so when the time comes you know the answer, and how to deliver it.