Some 0000 steel wool would take that rust off with no problem, and it won't have any negative effects on the polished steel either.