There are a plethora of cheap 1k to 4k waterstones from brands like King, Ice Bear, Suehiro.

Sand paper works pretty well also.

I have come to really like the Japanese stones, an Aoto is a excellent bevel setter and is "inexpensive" for the size of stone you usually get.

As for cheap finishing hones, 8k-10k, some barber hones make their way in to those ranges.