I always polish out the "shank" if the razor is out of the scales no sense in putting it back in with anything but clean bright steel...

Just to clarify you are talking just polishing, no grinding on it right ???