The pumice stone would be used dry. The idea is to sand the nick even with balance of the surface.

Saddle soap contains a wax element. Wax on a strop is not a good idea.