Villagers will trace to an invisible workbench that is clearly nonexistent. They do this in Realms a LOT. As you can see in the screenshots, I use the /data get command to see the job site of a villager, and it leads me to the inside of a wall.