I was in a village with 12-15 villagers and the villagers started to disappear until there was only one left. Though they went into the houses but they were all empty. It happened over time and not all at once. Game setting Peaceful.