Nope, no harm.
I use it for that on all kinds of stones, natural and synthetic.