I have the same issue with my neck, the only thing that work is, a keen edge and a sything stroke opposite the direction of growth, (ATG) after a with the grain stroke.

I do a 3 pass shave 2 with...