Basically the villager is constantly trying to claim any workstation that might be outside of it’s pen or stall but can’t actually claim it because it technically can’t get to it. Then, when you place your workstation down, it will take a while to reassign to that one and claim the one you want it to.

There is another report that has a bug very similar to if not the same as this one but it says it’s only on 1.19.2 and other prior versions. I’m making this so it is known that this is also on 1.19.3 as well. That is probably obvious since that one hasn’t been fixed yet but I’m just doing this in case.

A workaround is to ensure all workstations nearby, even if they technically can’t get to/pathfind to it, are broken. I only needed to break some barrels that were in my trading hall but others may need to break more that are farther away.