Old cave generation stops at y level 1 although the newer generation goes until y level -64. This can create some caves ending sharply in a horizontal wall if the cave was heading down or it can create a half cave with a flat floor if the cave was going along y level 1.