Sometimes when I spawn near a village I go near it and there will be only like 3 or 4 villagers. Also if I leave a village with a lot of villagers for a long period of time i'll go back to that village and all of the villagers will have disappeared. I've tried breeding them but that also doesn't work because they still disappear after a while.