The villager was in a building with double doors.  At first he couldn't leave, even though one of the doors was open.  Then he left through the second door, leaving the first door open.  I noticed this happen in each of the buildings with double doors