You could start off cheap, then move up to the good stuff, depending on if you like the experience or not. I agree with the drug store brush and soap. You could also go to a health food store in your area and pick up some Kiss My Face Shave cream for $4USD, it lathers up pretty well.

As for a bowl/mug/cup go to your local Goodwill/Salvation Army and look in the housewares section. I got a large soup/latte mug with a handle for 65 cents and I prefer it over an expensive Wedgwood scuttle that I have.