Can be a fear of the building itself, or of organized religion.

May stem from a negative experience with a religious institution.