My personal opinion is if it needs to be lapped, lap it.

But it seems that you gain some enjoyment from the aesthetics of the stone with the Kanji, nothing wrong with that so long as the stone is flat.

I lapped mine off right away to make sure the stone was true.