Naturally spawned iron golems stay agro after I kill all the previous Agroed ones. 

so I have this massive trade hall, it will naturally spawn 2-4 iron golems at a time. Sometimes I have to fix the lag and so I will kill all of them, but everytime I do the new golems the villagers spawn will agro on me even when I've done nothing since the purging of the previous ones. They would spawn and act like everything is fine until you get close to them and that's when they agro on you. 

I don't mind all the free and easy iron but I would rather use my trade hall for trades than an iron farm.