So, I got bored. 

Booted Minecraft. Created an old world. Exited the world. Turned on caves and cliffs, then exited again. Finally, I turned the world infinite. I actually find this cool... I'm just pointing it out and I don't want a fix tbh. I think that some cool survival bases could be built using this glitched terrain as a frame. 

You can see a demonstration of this on a livestream I did, linked here: https://www.twitch.tv/videos/1106429140