tape around the pin the file flat then use a center punch to tap the pin out.
The risk here is that you might take the metal inlays off.