I gave myself all different sword types, none of which even register as punching with the weakness III effect active, then I wanted to try enchantments and noticed that no matter how low of a sharpness/smite/bane enchantment I put on anything it would always register as a punch (smite and bane only against the representative mobs).
(I will create another issue about this where I will go into detail about how this works)

To test if this still did damage I put a sharpness 1 on a wooden sword and started smacking a small slime, after doing so for a bit I figured that it didn't do damage but continued for the fun of it, until my game decided to crash.