I don't think it will affect a razor unless you are using a lot of pressure when honing, in which case the scratches might lead to microchipping.

I figure the only way to get rid of problem areas...