Before messing with sandpaper do what Jim said and crumple aluminum foil into a ball. Then just use the ball on the rust as if you were sanding. It's some kind of reaction that makes the rust come...