Occasionally, the realm will freeze/crash for all players (including the host). When a player leaves due to the crash, they will be unable to join until the realm fixes itself. I have not been able to find out what causes this, but I'm pretty sure it has something to do with the servers and not the game itself.