To combat this, I usually rinse the stone under the faucet once I hear/feel some loose bits rolling around. Usually around 20 laps.

My sprayer isn't quite as effective in clearing them off the stone