Cheap brush, soap and pre shave and be had at the local drug store for about $40. I made my own paddle strop with a large piece of bridle leather and a 3' x 3.5" x .75" piece of oak $20. As far a a razor I would get a vintage razor from the classifieds.
Post up what neck of the world your in. There are many here willing to give you some face time, and help you get started.
Welcome to SRP.