Sounds to me like you are employing different grip dynamics from one direction to the next.

I make sure that, no matter which direction I am honing, my thumb rests on the edge side of the shank...