Zombies will try to get to villagers that are floating far above them, and will end up pacing back and forth under the villager to try to get to it.
They will even ignore nearby Villagers to try and reach it if their pathfinding found the floating villager first.

Edit: Issue used to be about floating villages, but after more testing, seems to be mostly about the villagers in the houses, rather than the house itself.