Mining with efficiency and/or haste makes the blocks you are mining reappear. When doing so your character glitches inside the blocks as well as getting pushed by the reappearing blocks. Also when you build straight up the blocks also lag which pushes the player off the tower, this also happens when mining down a pillar of blocks you get pushed off. Crops will sometimes have the same affect when breaking and placing them.