When a village is placed close enough to a pillager outpost, if a raid happens at that village, any pillagers that spawn from the pillager outpost will join the raid. This creates a constant stream of pillagers that keep the raid bar filled and don't allow you to progress to the next wave. Also, most pillagers in these raids are not agressive to the player.