If you are cutting in the same general area repeatedly then the root cause could be the facial contour and skin properties.
I cannot do a "down stroke" on my cheeks. Even a round point will cut. All cheek strokes are Across The Grain.

You may want to experiment and see if a different stroke direction solves the issue.