In my single player world I started to build a village in a jungle biome. I moved two villagers from a desert village to start breeding. Even if the babies are born in a jungle biome sometimes they still get the desert skin.