What grit of diamond are you using? Chromium oxide also comes in different grades which may have some bearing.

On the few occasions I use diamonds I use a paste marked <0.5 micron on leather...