The green map markers that appear when a map is put in an item are permanent they remain even when the map and item frame are removed

What I expected to happen was...:
When I place a map in an item the green marker showing its location appears when I remove the map the green marker should also disappear.  

What actually happened was...:
When I removed the map the green markers remains there if I then put the map somewhere else I end up with multiple markers

Steps to Reproduce:
1. Create a map
2. Place the map in an item frame
3. remove the map from the item frame