When an illager looks at me, he looks slightly downwards other than right at my face, the villagers one is correct and where the looking point (red part of the hitbox) needs to be.