I've heard of people filling the holes with anything from epoxy to JB weld and then re-drilling a hole :)

personally? I say just leave it, maybe brass-tube sleeve your pivot pin to increase...