My first guess is that you have a little unevenness in your "away" stroke. I've experienced the same thing and it took practice to fix.

A very even x-stroke should hit the whole blade on your...