Intended behavior for Endermen and how they work in Java edition is that they give you 4 game tick leeway for us to look away even if looked at in the eye. 

This feature is lacking in Minecraft Bedrock edition as can be seen in attachments below despite the version arguably needing it more due to its many different control schemes.

Pojavlauncher was used for taking Java edition footage due to having no access to computer at the moment