The villager profession are unable to be removed by removing a workstation, they keep the profession permanently. I tried to get a specific librarian I want, I gave it a workstation, then removed it and the villager is still a librarian. I did not trade with the villager.