My first set up was around $100 for a honed Gold Dollar, strop, brush and soap. There is a lot of debate about GD blades that I don't want to get into, but for me it was a good intro to straight shaving - after that, I knew it was what I wanted to do and over time I expanded on everything, one piece at a time (or several pieces at a time once RAD had kicked in).
All the best with starting out!