Yes, soap is soap however do you know who owned it? Do you know for a fact it was used for soap? Maybe it was used to apply ......(fill in the blanks). That's why I don't use a used brush.

Even if it was used for shaving soap no matter what you do you'll never get the base of the knot really cleaned.