Unable to connect to friends world and vice versa. All have xbox accts and some of them can join other worlds but they can't connect to mine/i can't to them

Friend status shows active and i can see their rooms/they can see my room but in both scenarios are cannot join the world