I would try it without using the divots.

Sounds like you are striking softly, but I'll state anyway. My 2 ounce ball peen, with polished head, I only raise about an inch, letting the hammer head...