Hostile Endermen, that have been turned hostile by other means than looking at their face will turn Neutral again when looked at.

How to reproduce:

Punch an Enderman in survival mode, and then look at their face.

The Enderman stops attacking the player as long as the player is looking at their face.

When the player stops looking at their face the enderman starts attacking again.