The iron golems don't patrol the whole village. They just stick together in a group. The village is walled (cobblestone walls) so is fairly safe. I made sure that there is easy access - 2 block wide paths between buildings and along the walls and created dirt paths to encourage them to roam. Someone posted iron golems clustered in the north. In my case, it is fairly central, near the bell.