I have a bunch of villagers in my world, and some of them work at the wrong job site blocks. I've had priest working at blast furnaces, leatherworkers working at fletching tables, fishermen working at grindstones, etc. The villager trades correspond to the outfit, not the job site blocks. I'll try to get a screenshot uploaded soon.