Villager Are supposed to Restock when they look at their WorkStation in working time 

[Time Tick Per days in minecraft  : 2000 ~ 9000]

But in Version 1.15.1 in SinglePlayer and multiplePlayer mode, Villagers restock only 2~3 times per day. In fact, villagers should restocks during working time.