I've not tried this but wouldn't applying lots of soap eventually dry the leather out? It's like if you wash your hands too much, eventually your skin goes dry and cracks.

I'd hate to end up...