If a villager goes too far from the village, then it loses it and can no longer live or work in it.
MC-155759 villagers leaving village
MC-156220 Villager tend to leave their village
MC-157485 Villagers don't seek shelter from hostiles