I don't anneal. I file the end of the pin flat before I start peening, and this makes it mushroom easily, making annealing unnecessary.