I'm with you, to a point. I also do not own a gun, and don't foresee owning one in the future. Though I have to admit, the way this country is going, having a gun in the house sometimes seems more prudent than not.
But that doesn't imply fear, just caution, just like wearing your seat belt when you drive, or having a life insurance policy.
And even though I don't own one, I still support the rights of others to own them, provided they are properly licensed and trained.