I have a village I live in, and punched a villager on accident. So the iron golems attacked me, as expected. I then killed the golem, and have been doing so for a while, I've killed around 20 now. Today I decided to stop the hassle and just die, so I let them kill me. I respawned in a bed near them, and they attacked me again. Now they are basically hostile mobs that can't be prevented.