You may try slowly working your way up to moving against the grain. I sometimes do two passes somewhere between with the grain and against it before shaving against it