Edit: with the recent tests I have been doing on Raids once again I can confirm this problem can be reproduced in the newest versions, fortunately I figured out what’s happening and it’s not only limited to Ravagers AI, in the comments someone also provides a very useful clip to confirm this.
To begin with the Raiders can sometimes spawn far away from the Village, they share a common goal and this one seems to be relative coords to the Center point of the Village and its boundaries that said at the very beginning they focus more on rush to this point before they remain with their hostile behavior, when a Raid forces these guys to spawn in a cave for example, here in the inside they try to reach at least the Village boundaries before they attack back the players.

A solution for this will be let the Raiders attack back if they get approached by the players while they’re trying to reach the Village limits, but even tho this seems like an obvious solution I suggest a more smart solution to compromise less the Raiders AI which btw it works fantastic outside of this problem.
First I think the spreading system for Raids should focus not only in x | z coordinates but make very strict exceptions when attempts to spawn the Raiders in low y coordinates in this case for Caves and the most annoying one Ravines (Most likely this seems to be the case to Ravines and Caves that has access to skylight since I have never seen a Raid wave spawning very deep below), so you fix 2 Issues at once you first prevent this behavior affects Raiders and it gets rid of the annoying search players have to do to find a Raid wave that spawned inside a Cave.

believe this issue happens when a Ravager can't pathfind to a Raid and their AI basically gets freezed, they stop moving, unless you push it, and it doesn't react or response to the player or other Mobs hits, naturally they won't approach the player as well.

At the beginning of a Raid Wave this guy spawned close to this cliff that seems like interrupted it's Pathfinding, after a while I found it but wasn't even trying to dodge this obstacle or try to keep up with the other Raiders.

But the most strange part was that it wasn't trying to attack me:

And it didn't react to the Dogs attacking or the hits that I dealt to him:

At the end it finally managed to move and try to pathfind again, but still felt into the same problem of not avoid the obstacle or react to me or the Dogs attacking him.

But this doesn't happen all the time, when there's no obstacles it pathfinds correctly with the rest of the Raiders

There still some tweaks missing to the Ravagers AI/ Pathfinding, these guys seems like are currently the ones that present problems more frequentenly on Raids or any Enviroment
MC-144202.