Exactly as in the topic, to reproduce this problem you need to go to the spawner of these skeletons in the trial chambers.
The arrow levitates in two ways, as can be seen in the photos.