Darren,
We all do it,me included...the "stropmeister" <g>.

If very small would leave it alone and if the razor catches on the flap I would carefully trim off the flap. If larger you could try...