Iron golem attacked me after I accidentally hit a villager (no kill). that was the only popularity change I did. even after switching to peaceful (and creative, out of desperation) the golem still attacked once I switched back.