Minecraft does not create a world icon if it is missing but also disables the "Reset Icon" button.
There are two cases in which a world can have no icon:
- The world was generated in a previous version
- You close the a newly generated world before entering:
- Create a new world
- Minimize Minecraft
- Open Minecraft after it finished generating the world and exit back to the main menu