OK, I think I figured what was going on.
The brush is so dense that it takes WAY more soap to fully load.
I work the face a bit then re-wet the brush, load more soap, back to face and voila- fully loaded brush.
Good for second pass too.

Still dries out pretty stiff despite extended rinsing...