I was exploring when I came across a ice river and went up too it and dug down

What I expected was there to be water under the ice block

What happened was there was water but the water was not appearing under ice blocks I tested other blocks and the water did appear but not under ice blocks