More info on how you are storing them would help. I always wipe dry with tissue after use and then leave them out to air dry for at least 24 hours or more, have never had a problem.
You could also save up all the desiccant packs you find in various products and throw them in the drawer with your razors, have done that for years. Steel storage containers can create condensation, and some types of leather can affect carbon steel. Have never used oil on any of my razors. Vegetable based oils can cause problems from what I have read. Hope this helps.