When playing with another person who is wearing a skin made in the Character Creator, after they exit your render distance and come back in, their skin turns into the default Steve skin.

From my understanding, this only affects skins that have been made using the Character Creator. Marketplace skins currently stay unaffected.