It does sound like overhoning to me and perhaps you still have micro chips. If you had rolled the edge I don't think you would get anywhere with the shave at all.
As much as you may not want too I...