When the position of the buttons has been moved, using the custom positioning, the button will move to what seems like the default position when the player moves through scaffolding.

This can be reproduced by:

Moving the button to a similar position as mine in the video

Walking through scaffolding