After breeding villagers, they have a tendency to despawn even after assigning them a job trading with them, and naming them. I maxed out a Farmer and it despawned as well as a fisherman.