I had the same problem when I used the dremel press, it got better when I bought a nice drill press..
But still had a little challenge with heating up the pin and melting plastic scales. Then...