Okay, today I wanted to check out the new update/snapshot (20w17a) and when I logged on it was raining through the mountain and into my house underground. It appears to only work on stone (I haven't tested every single block).

I tested and if you place any other block, for example, tnt it appears to have stopped the glitch/bug.