If you are on a horse, you don't load the world so it makes exploring on a horse quite difficult.
When u jump off the horse it loads instant.
I tested this in a multiplayer and single player world.