Our family Minecraft game is stored on our Switch. My wife can connect by iPhone but my son is on Xbox series X and I am on Xbox One and we both get never ending Locating Sever. Our connection is fine and we have both deleted and re installed the game so the issue is at your end.

The Switch host version shows that we have connected to the game but our Xboxes just say Locating Server.