It is possible to slide sideways off a tamed horse without a saddle. It depends on the orientation, but pressing the space bar sometimes results in going sideways or forward instead of backward.