This tends to embed grit on the surface of my Norton 4k/8k, do you run into this at all?

I water it while lapping and scrub under running water with fine steel wool when i'm done, but there are...