Simply wipe the oil off with a tissue. Slight traces won't hurt the strop.

If the oil has gummed up you may need a solvent. Take care to keep it off the scales