Caves almost entirely stop generating below Y = -30. The only caves that generate seem to be lava pockets and amethyst geodes, and it is incredibly rare to find a cave that comes within 30 blocks of bedrock.