Hi Daniel,
Perhaps your razor's edge is a little bit over-honed and therefore rough and scratchy as you describe. Have you tried stropping a little bit more than usual on the linen side of your strop, or perhaps on a strop that has been treated with chromium oxide paste? That might help bring back the smooth edge.
Best wishes,
Jeff