If you open the Singleplayer menu, and attempt to load a world that you have deleted, moved, or renamed while the menu was open, Minecraft crashes. Instead, it should give a normal error message, even something simple like "Error loading world!", so you don't need to relaunch Minecraft.