Just recently I purchased a small Rooney brush from Jim over at Vintage Blades. I too had the same problem.
At first I was loosing a few hairs each shave and attributed it to newness of the brush....