Most (not all) caves in Amplified worlds are flooded, far more than in normal worlds. The first attachment is Amplified, the second is normal worldgen. 1.20.1, no mods, tested on multiple worlds and at various coordinates.