Yep, try a different soap since that's the easiest to rule out. if that isn't it try a cheap boar brush or synthetic and see what happens. What kind of badger are you using? Pure can be very scratchy...