Once a villager has been assigned to a workstation, he can only make his twice daily replenishment from that workstation. If that workstation is destroyed (or if you import villagers from an older world), they aren't able to assign themselves to a new workstation, and become useless.

Villagers being able to replenish stock from any suitable workstation would fix this issue.