Pausing the game should stop all entities from moving. When the pause screen is open, the entities do not appear to be moving, but their positions will update as soon as you unpause the game. To trigger the bug, simply spawn an entity, pause the game, and then unpause. It will have moved.
This is in singleplayer.