It sounds to me as though your mind is picking up the patterns of his proximity. Our minds are amazing machines and will focus on things if given half the chance.
For the longest time (and sometimes, even now), I notice when it's 9:11 in the morning... since 9/11, my mind picks up that pattern.
I wouldn't worry about it. Just try not to extrapolate any supposed meaning to it.