How can you straighten a Pivot hole?

[ndw76]

Today I rescaled a Fredrick Reynolds razor in a recycled pair of buffalo horn scales. When I finished I found that the edge was badly touching one scale. Thinking that the problem was my re-pinning I tried again with similar results. The solution I found was to use more washers on one side of the tang than the other. Even with this solution I found that the edge was still hitting the scale. This is one razor that I am going to have to be careful with.

So while I was trying to figure out why I had this problem. It turns out that the original holes drilled in the pivot end of the scales are not even. Instead of being drilled at a 90 degree angle it is more like an 85 degree angle.

I have heard of uneven holes in tangs of razors, which people fix by filling with epoxy and re-drilling the hole. But how does one solve this problems with uneven holes in scales?