Minecraft.exe is started with a path name that cannot be set in Windows Defender Firewall, so you will not be able to start a client from the launcher or log in to the multiplayer server unless you allow all the sends in the firewall settings.

Correction: The client can start, but the button is displayed as "Play Offline" instead of "Play".