For me, yes, in general I have to like someone or find them attractive, either physically or mentally before the thoughts start entering my head. Something about them has to engage my interest for that, not just that they're in the room.