This is a good point. I usually clean up the surfaces of my stones in such a way...Some stones are more forgiving than others...

The DMT XX is great for lapping quickly, or for really hard...