I tried Yardley's hand soap to shave with.

Non-shave soap can be used to shave with sucessfully, but in no way could it be comparable to the comfort and cushion you will get with a true shave...