If you don't want to polish the whole blade you can use a glass fibre pen to remove the rusty spots on the blade. The rust is usually deeper than what you see.
I would suggest to re-set the bevel with a lower grit stone after cleaning up the rusty spots before you move on to finer hones.