Villagers sometimes stop farming

I used spawn eggs to get villagers. I was constructing a villager breeder with a farm attached but the villagers will not accept food and the farmer will not farm. I have tried using the replace item command to empty their inventory or give them some potatoes. 

Update: I have conducted further testing and I have found that this also happens with naturally spawned villagers.