I settled a small village of 7 villagers (1 Farmer, 1 Cleric, 5 Librarians) at my base, and after AFKing for a while in a farm nearby there are loads of golems both inside and outside of the main building (but mostly outside, there's not a whole lot of room for them to spawn inside). I've been culling their population pretty regularly as a source of iron so I didn't think much about their spawn rate, but this made me think that there might be something off.
The area around is well lit and hemmed in by berries and fencing, so I don't think they're spawning from the villagers panicking due to hostile mobs.
E: Forgot to mention that all seven of the villagers have been zombified and subsequently cured. Also, there are five unemployed villagers in a spawning room nearby (the small netherraack building) that also seem to be spawning some of their own golems. The unemployed villagers have not been zombified/cured.