When using a map which is already fully explored, the map shows the blue arrow for player 2 in the home base location, even though player 2 is not playing.

The last location of player 2 was in the home base location prior to closing and saving the game. Player 2 has not yet played this world after syncing from the old game to the new game.