As I right-click the normal villager, it works perfectly. So does not the custom ones. When I attempt to trade with the custom villager (with custom NBT), the GUI closed by itself, and I consider this as a refusal and bug. I didn't press and hold [ESC] during the situation.