You might want to recheck the angle you are using. Not all DEs work well at the same angle and it is the same with SRs too. I'd try placing the head of the DE flat on your face with the handle parallel to the floor. Rotate the handle downward till you just feel the blade on your skin. That should be a good angle. If you drop the handle lower then you are scraping more than cutting the stubble.

Bob