The least-costly option for razor and strop (you need both) is probably

Whipped Dog Straight Razor Sales

For a "budget razor" that shaves well, Larry's prices are hard to beat. His "Poor Man's Strop Kit" includes both a leather strop, and pasted strops. Should keep you going for months.

A brush and shaving soap (or shaving cream), you can find in most drugstores.

Charles