If you stand still and select another slot in the hotbar the hand will appear again, but if you drive a boat you won't be able to for example take a bow and shoot. (Same for passengers)

While on horses you can take your bow.