I'm not sure if this is a bug, or something horses normally do. My horse jumped into a huge ravine, I thought that they would not jump into places deeper than 3 blocks. Nothing pushed him, he simply walked straight in.