I don't worry about the sides of the hones at all. You could try a scotch brite pad to clean them.