When you hold down right click with the fishing rod in hand, it slows you down and causes you to shake your arm, the slowing of the player when the rod is cast is an annoyance in pvp.