Have you got a hardware store chisel or something of that sort that you can rub the back of on the surface of the stone?

If it's a stone intended for razors, that'll knock a lot of the harshness...