/replaceitem entity @e[type=Zombie] slot.weapon.offhand dirt is supposed to replace the offhand slot. This works for players, however it does not work for mobs even though they have the HandItems tag containing two entries: The item in the main hand and the item in the offhand.