Held items (i.e. pillager crossbows and piglin swords) render in front of the wold border, but the mob holding them does not. This does not seem to apply to armor.
MC-174404 Arrows are rendered in front of the world border
MC-162340 World border is rendered behind transparent blocks
MC-174959 Dropped items are rendered in front of the world border