Piglins AI activities seem to be higher priority than panicking when seeing/being near Soul Fire. This includes pathfinding, interacting, looking at the player and possibly more but I've not tested all of their activities so I'm only listing the ones I know are affected.