You could try a wire brush, which should remove most of it. Lapping stones should be treated like any other: make sure it's thouroughly dried before putting it away (assuming that it's the 325 of...