Chunk rendering is slow across the board. Whether walking, horse riding, or flying with Elytra, chunk rendering halts the game completely. You hit an invisible wall while flying with Elytra, when the chunks haven't rendered, and begin to fall.