I don't really know how to explain this, just look at the pictures.
The first picture shows my FOV when I look at the wall of this village house.
The second picture show what happens when I look a bit up and to the right.
I am pretty sure this is not supposed to happen.