The van der Hagen set at Walmart is hard to beat for a quality boar brush and soap for a beginner at $8, bowl included. I'm still using that brush.

I originally got into this to save money, too. Currently, it will take me 3 years to break even, though seriously, you don't need to spend that much. Sight unseen at whipped dog, poor man's strop from the same place, and the above-mentioned soap set will definitely get you going. On the cheap.