A coupla things I learnt the hard way.

Make sure your pin punch is long enough not not bottom out if the pin lets go suddenly.
If you use a timber base with a small shallow hole drilled in it...