When I would load my survival world it would crash about a half a second after I spawned in. After looking through the crash reports I found this:

Entity being ticked –
Details:
Entity Type: minecraft:drowned
After seeing this, I loaded the world again, and quickly set it to peaceful, this solved my problem.
Obviously the drowned loading in as I spawned in was causing the world to crash, and because I was able to despawn it before I crashed, it fixed my issue. Bug found!