Grab two torches, place one in offhand and one in the inventory, click the switch to offhand button from the inventory torch and it will switch the two around instead of stacking.