I suspect that a drill press is your only option, and even that may not work because it may just spin the pin before you get drilled far enough to get it loose.

The only other option I can think...