On Bedrock edition, when Allays move around they have a special animation when in motion, where they lean forward, and if not holding an item, their arms tilt backwards. It seems this animation is not in the Java edition.

If it is, it may be not appearing because of MC-249838, though I'm unsure if that's the definite cause.