If you change the default playback device from Windows' control panel, the game does not change its playback device to match it.

Ex: Instead of playing sounds from your speakers by default, you change it to your headset. The game still plays on the speakers instead of the headset.

If you restart the game, it will use the new default playback device.