I understand. I am very lonely much of the time, and though I have spent my adult life exposing myself to all kinds of ideas, cultures, books, music, and food, it seems so much of the time that I do not have anyone to talk to, because no one knows anything, except the latest pop news. I really don't have close relationships with gay men or lesbians, because vapidity and shallowness is held in high esteem in this culture, and if you don't like Cher, or Broadway musicals, or just sit around talking trash about people, then you don't matter! (Do I seem a little bitter?) Also, when you talk about things too dark, too deep, to profound, or too verboten, you tend to loose your audience.
I don't talk about the atheist thing either because it just is no big deal to me, but it is depressing sometimes when you feel that no one is around who understands you.