I always get a bit of leather from my strop, I always just wipe it off before the linen side. It doesn't seem to have any negative effects on the razor or the strop.
Kurt