If you removed the active rust and keep the area dry, it won't spread. To get the staining off you'd have to take the razor apart and remove the metal (sand or buff or whatever).

Personally, I don't like putting oil into the pivots, because it will attract and hold dirt and grime and gunk. Keep it dry and you'll never have a problem.