How about plain old oil stones.

India stones to Arkansas stones are a good time tested medium to fine progression that would do what you want.