When I join my brothers realm, my skin swaps with my friend (other player on the realm)

When we refresh our skins back to normal, after a few minuets it changes back!! Its so annoying!

As you can see from this screenshot my skin is my skin, but me (in the background is my friends skin..