By trying to push a moveable block (A.K.A. Dirt) outside of the world border, the piston head will enter the block instead of not extending. As a side effect of this, you cannot break the dirt block after. any blocks you break are under the dirt. (But, you cannot pass through the block.)

It makes more sense in-game