For when I bother oiling my razors (not very often) i do pretty much what deepweeds and Utopian do, which is to keep an oily rag in a ziploc bag, and wipe the blade with it.
Sometimes I wipe it...