I have always left it in because I didn't think it made any difference. But if it shortens the life of the brush as Alan says, I will start rinsing my brush after use