Well, I got my hands on some 3M 5 micron lapping film and used it on the stone, it seems to have fixed the problem completely.

I guess the Shapton Glass lapping plate I borrowed wasn't completely broken in, and was leaving peaks in the stone...?