You're likely not exerting the same force on one side as you do on the other. Make sure you have your thumb on the edge side of the shank on top and your forefinger on the spine side underneath regardless of which way you're going on the hone.

X