It has happened to me twice. The first time I was breeding villagers in order to repopulate a dead village. The second time was in my "trading hall" with the villagers with the best trades I could find. In both cases several of them disappeared, even though the rooms were well lit and the villagers were completely locked, so it wasn't because of zombies. I tried putting tags to them, but they keep disappearing.