Map Markers Oversight?

Issue: When a map marker is placed on a map there dosnt seem to be a way to remove it without being inside that same map.

EG: I place the red marker on the black trench map then return back to the over world to do something else. now there is no way to remove/re use the red marker on the over world map without first returning to the black trench to remove it.

this issue is possibly only relevent to the color marks as theyre the only ones limited to a single copy.

Suggested improvment: