It's a pretty specific glitch, but with the redstone setup in the pictures below the piston will stay powered even though there is nothing powering it. It will stay extended until you break the piston even if you destroy any piece of redstone in the vicinity.