When opening inventory, with even an empty fist it will cause a punch or if there are blocks in your hand, cause it to place. It is the same with water buckets, shovels, hoes, etc.