Pretty much anything hard enough will work, but unlike drill rod putty knives are soft metal so you'll likely wear away some of the putty knife if you use it on the stone.