Villagers become weird hermits. At night time, they'll go inside. After the night, during daytime, they won't come outside. They'll instead stand at the door and open and close it without actually leaving their houses. They do leave the houses if you open the doors for them, though.