I think that darn brush plus the warmth of your face are drying your lather up way, way too quick.
Get your face as sopping wet as you can, apply lather with wet fingers, spread with as much hot...