It looks like when putting a large amount of villagers into a small space, they seem to pass through transparent blocks, (Glass). I had this problem when building the Iron titan. They somehow got out through the Glass.