The haze of the dremel might have masked the scratches that ended up showing with the buffer.

What compounds or products did you use on your felt wheel?

And why would you start with green...