That's pretty much what I do, sometimes, I'll throw a few drops of Glycerin in there.
I never have trouble with anything drying out on my face. The biggest thing is patience, and really learning...