If you're tight on cash, the least expensive "starter set" is:
. . . A vintage razor and "Poor Man's Strop Kit" from
Whipped Dog Straight Razor Sales
. . . A brush and shaving soap from the local drugstore
There is no "really good, really cheap" new razor, as far as I know. The Gold Dollar razors (Chinese, and cheap) have mixed reviews on this site. The least-expensive _new_ razor with consistently good reviews is the Dovo "Best Quality" -- about $80 from Straight Razor Designs, including honing. [If you got a "Timor" razor, you could report back to us about its quality . . . ]
Charles