I used to not rinse my brush after shaving, but after a while the hairs started falling out. Now granted it was just a cheap vdh brush and it was probably not completely due to leaving soap in it but...