When standing on the edge of non-full-height blocks (path blocks, soul sand/soil, farmland, etc) some sort of inert force pushes you around.

This issue does not exist with the following non-full-height blocks:

Slabs/Stairs (any kind), Fences/Walls (any kind), Snow layers, Honeyblocks, Campfires, Beds.