Maybe it's just too revealing for you right now - I struggle with looking my husband in the eye when we play, it feels like he sees all the way into me.
(I've had similar experiences as you - PM me if you'd like to talk)