Testing this on multiple maps, with difficulty set to hard, I've noticed that there are no Endermen spawning in the Overworld. On one such world, I was only able to get enderpearls and eyes of ender by trading with a Cleric villager. Endermen spawn in the End, no problem. But none in the Overworld.