When I first started my world I had a few passive mobs such as a chicken a few sheep, horse and one cow. I ended up caging them and not long after played in peaceful for a while. Upon placing my difficulty all passive mobs stopped spawning and no other passive mobs would spawn.