I was just fooling around in a village when I saw some villagers like this. It only affected some villagers, others were normal. Setting the time to night only makes the sit by their bed, not go in it.