Another tip that I picked up on cleaning rust was to wet a piece of crumpled up aluminum foil, but I keep forgetting about it when I need to remove rust. Now if I can just remember both these tips....................
Although aluminum is soft, the surface of the foil oxidizes to form layer of aluminum oxide which is the abrasive used in most synthetic waterstones, so be careful using it on your razor.