Right clicking with anything on a fence will just make the object swing like you are just flipping a lever repeatedly, That's a little hard to deal with in a mineshaft.
Doing this with a block can place the block over the player witch can kill them.