well it could, but you won't like the result.
Rust leaves pits and if you only remove the rust, as opposed to sanding the entire surface, there will be deeper pits.

Start with a 800 grit paper. ...