I had a small, underground village, and it was completely safe and literally nothing was able to get to the villagers. I also traded with them a lot, but one day i noticed that despite it previously being a thriving village, there were only about 6 of them left. I genuinely don't know how this happens