Yes, that can happen. I only remove scales if i really have to.
I start at around 240 grit if they're really pitted & work through up to 1200 before buffing, but it depends what state they're in....