After I bought a woodland mansion exploration map from a cartographer, I went to the location the map showed (as seen on the screenshot). However, turns out there was actually no woodland mansion to be found, even after some exploration of the immediate area.