Sounds like lack of prep. If your stubble is especially tough, then you need to pay even more attention to it.
Are you shaving after, or in the shower?
Wash your face well to remove the oils from...