Pillagers will just pile up surrounding the center of what was once their outpost. They won't try attacking villagers that are in the center. I have made a clip which showcases this issue, and with a raid active. I have slabbed out all of the big caves under this region. Checked with the server owner himself if any of the server's plugins could be causing this. He tried many tweaks and with no prevail. Our latest attempt was to give the villagers professions. This, too, failed to make a difference.

Clip of Issue: Click here.

Observed Result:{}

Pillagers are "stockpiling" around the raid farm, which is centered on the center-most block of where their outpost once stood.

Expected Result:

Pillagers ready up and try firing on the villagers to kill them.