I thought that maybe a zombie destroyed doors and attacked the villagers, but there weren't any zombie villagers. So I fence gate the doors and made sure the inside was bright enough. Came back later and sure enough, missing doors and missing villagers. The only doors that disappear are oak and dark wood oak.