The only issue with Gorilla Glue is that it expands as it cures. I've had a problem with this when I used it to make pens. The expansion is enough to cause splitting on the wood blank. As the mortise for the knot is the weakest part of the brush handle, I would worry about the same thing possibly happening.
It might also expand over the edge of the handle IMHO.