I have no direct experience with this, but I've seen mention in threads previously about using strop dressing, then a smooth glass bottle to smooth the leather out.
Let us know if you work it out.