Upon entering a desert village, villagers had spawned normally. After a few day cycles, the villagers largely started to congregate just on the perimeter of the town, but mostly in 1 particular spot. Some wandered off into the desert. None of them would enter the structures at night. Gradually, all villagers dispersed into the surrounding areas, or were chased/killed by mobs.