That's exactly how I do it. Some put the cream on their hands and rub it on their face, but I prefer to put it on the brush. What do you mean(specifically) when you say you're having difficulties...