When you have a large village and place the beds on one side of it and the workstations on the other, the villagers can't find, their workstations and can't expand the village.
Basically, your village is limited to the villager object detection range.