When there is a grass path under ladder and when you walk into(onto?) ladder the character does not start climbing automatically, you have to jump to activate climbing. I think it is because the game thinks that character is not on the same level with ladder. So there is no continuation of movement. It does not start climbing when you keep walking.