1) real hammer and real anvil would make a lot less noise than your current setup.
2) tapping directly on top of the pin won't do as much as tapping around the center of the pin to help mushroom out...