I was using my Enderman farm, and noticed that several of them had the aggroed skin and were shaking, like I had aggroed them. I hadn't. They weren't attacking me, but they still looked like they were aggroed.