It won't do any serious harm. You'll just do more hand sanding at lower grits so it's all good.