I finally took everybody's advice and bought some mama bear soap. It didn't come in the pretty wooden bowl but this stuff is something special.

It doesn't dry out before I have a chance to shave, doesn't irritate my skin, and its cheap!