I experienced the same thing, but for a razor that is curved (like the one I got from Nelson), the razor needs to roll from heel to toe while honing.
For the moment I control this motion by holding...