My vote would be to remove the rust and keep it as is.
Red rust is active and will continue to eat your blade unless you stop it.
Brown rust is inactive and wont deteriorate your blade if left...