Villagers do not chose the closest work station as their own, instead will chose work station up to 96 blocks away even when testing. This is incredibly frustrating and not at all intuitive.