When picking up arrows inside the creative inventory and clicking them on another arrow, they don't, as expected, disappear from your cursor but rather pick up another arrow that is the same kind as the first one you picked up.