After killing all pillagers in an outpost (except for the captain) in creative, I switched to survival. The captain failed to attack me, even when I attacked it. The effect appeared to be exclusive to the captain, as a regular pillager I missed in creative attacked me as soon as I entered survival. Bad Omen was still applied after I killed the captain.