When you click on a item in the furnace it does not withdraw it. This applies to all slots.

I expected it to put the item in my inventory

What actually happened was absolutely nothing.

Steps
1. Open furnace
2. Place item inside of furnace
3. Attempt to take it out