I think thats a neat and non permanent way of adjusting the loft and heft of your brush and I don't see any reason why it shouldn't work well!

The only thing I would do is take the band off after...