I'd be more apt to say your bevel is not properly set. I'd say go back and make 100% sure your bevel is set with tape. Keep tape on through the progression. Strop without tape.
And yes you should...