Some villagers at one moment start to ignore daily schedule. Before it they follow daily schedule exactly.
First one villager starts to ignore, then other and so on. It happens randomly. In the morning such villager don`t go to work and go to the village`s border then they don't go to the meeting and don`t go to sleep. It continue all time. In that time the villager gets unattached from his work block. His work block can be attached to other villager. At that time defected villager keeps his occupation and can trades, changes prices, raise his work level. Golems don't react when the Player attack defected villagers.
It affects in any game mode.
There isn`t this bag before 1.14.4 version.