If it were me, I would grab a cheap boar brush from target, a different soap, lather in a bowl, then give it the same amount of time. If this changes things, then rotate in "1" item at a time and watch for the change.

What is your razor & stropping technique?