Abrasive paper works fine!
Any grit needed to remove dents/marks and then up to what you feel comfortable with.
I usually go from 220-600, on some of my goldsmiths hammers I go all the way up to .5...