On multiplayer server, when another player hits an entity (tested with mobs & item frames) or breaks a block, it causes my hand to wiggle (only if hand is empty).
Also happens if the other player interacts with some blocks (tested with wooden door), presumably any interaction where the other player's hand moves.