The fact that pillagers spawns at 8 light level (instead of 7 like other hostile mobs) makes it really difficult to light some buildings, they tend to spawn close and sometimes even inside (specially in desert buildings that usually have sand floor) close to windows and near players.

They also like to spawn in some farms (like sheep corrals that need grass)

Lower down the max light spawn to 7 could help avoid this.