I've been experiencing this for a year.
While minecraft loading heavily (Teleport, or massive texture loading), it just crashes and goes back to xbox home screen.
It happens a lot frequently if two players are playing together. I've tried on Xbox One S and bought Xbox One X whether it was console issue or not. And XOX still shows same symptom (my money !!!! )
I am not using XBox Live just playing locally.