If you're confident about the razor, I would revisit the lather.

Give your face a good wash with soap to get rid of any oil, that will allow the lather to get into your beard and soften it....