Upon dismounting a horse (etc.), said horse disappears. 

Note: you can still hear the horse, though it is not visible.

when saving, exiting and reloading the world, the horse is back to being visible and mountable as normal.