It's your razor, so do what makes you happy. But the rubber is original to the razor, and if you take it off you can't put it back on. I would leave it on, as I believe it was intended to be left...