When you fly down onto a surface, your movement slows but you retain the flying state. This slow movement persists after moving horizontally off of said surface, even after stopping and restarting movement. Only moving vertically will restore normal flying speed.