If the diamond helps after the 16k it may be that it has cleaned up a false edge or micro burr from too many strokes on the 16. After that point you could do say, 2 or 3 feather light strokes on the 16k again & see how it shaves. Another experiment. ;)
btw , not advocating excessive laps on any stone but it can happen.