Currently the only item that can be placed into the furnace is the thing that would smelt,the fuel can't be placed in.Any output items such as clean stone cannot be removed from the furnace.
Long story short,the only item slot that works in the furnace is the input item however these items can't be removed from this once in place