Your blade not being sharp enough could be a cause...

You may also try to shave your mustache with the middle/back of your blade instead of the point... One can have that way a bit more...