There are quite a few members that use, or have used, olive oil as a pre-shave oil. It sounds like it works for you, so why not use it? If you have enough residual oil on your face to allow a touch up without water or lather you really aren't hurting anything, assuming that you aren't irritating your skin.