Usually it is the metal build up. I use the Norton flattening stone to clean and lap mine at the same time. It really makes the job easy.

Lynn