Sum up : Villagers walk through fences.

While building rooms for villagers, I noticed they would go from one to an other crossing wooden fences at first. Replaced it with Iron fences, same problem.

I caught one in action : he becomes black and his shadow quickly goes above the fence.