villagers occasionally ruin farmlands even without height gaps

They can walk through farmland blocks, and at a very low chance, they just brake it.

it seems like it happens more when they stand on a block for a while.

(So villagers with no jobs make this problem more often since they just wander through here and there)