Well, do you have the other side of the pin on a very hard immobile surface like an anvil or thick steel plate? If so, it should only take a few light taps.