I would certainly get the rust off. Rust is like cancer. Tiny amounts of free oxygen within the particles of rust will create more rust.

Get it off, and get it off now.

Once it's off, you've...