PMFJI --
Your best bet for "one-stop shopping" is Whipped Dog Straight Razor Shaving Equipment
The "Whipped Dog" "sight-unseen" deal (including the Poor Man's strop kit and shaving brush) is very good for low-budget, first-time straight razor users.
You could buy a used vintage razor from the "Classified" section on this website for $40 (and up), and get a strop / brush / shaving soap separately. You'd spend just as much money (or more), and have to deal with several vendors.
Think of this as an _experiment_, not a commitment. If you like it, and have the cash, you can "upgrade" equipment, one piece at a time.
Another question:
. . . Where are you ?
There might be somebody local who can give you a hand.
. Charles