I never remove it. It's not 'goop', it's soap or cream. I've done it this way for two years and have never experienced a problem. The 'goop' dries out quickly and virtually disappears.