Farmer villagers will not harvest crops without the player pushing them into the crop. Until then, farmer villagers look to the crop and stand there.

I have confirmed that mob griefing is on in my world.

Could it possibly have to do with mob collisions being re-enabled?