If I were to put money on anything about this, I'd say that this "wet thumbnail test" is your problem.

It is my experience that dragging a finely honed edge across your thumbnail will negate shave...