I have applied a splash potion of weakness to a zombie villager and a zombie villager baby. However, when I right click with an golden apple nothing happens.

(This particular zommbie villager was spawned from a dungeon. Do the zombies have to be in a Village zone ? or can it be any spawned zombie villager on the overworld?)