I've been able to use hydrogen peroxide to get grimy stains out but if it's rust that probably won't do it. I have never tried something like CLR because I was afraid it would damage the horn...