One who has a synagogue and does not go in there to pray causes exile for his children.
Sefer HaMidos, Prayer, Part I §36