When using a crossbow in the offhand position, it will not load fireworks whether from inventory or from the hotbar, even if you are only carrying fireworks instead of fireworks and arrows.

Offhand crossbow will still load regular arrows regardless.