Held items (i.e. pillager crossbows and piglin swords) render in front of the wold border, but the mob holding them does not. This does not seem to apply to armor.
Arrows are rendered in front of the world border
World border is rendered behind transparent blocks
Dropped items are rendered in front of the world border