Thanks Max, I wish I would have read this about 10 minutes ago.

I removed the pins and wedge and started trying to remove the bolsters. I'm not sure if all are like this but mine seemed as if they were heated up and burned in to the scales. The green paint actually looked like it may have been wax. (so just the fact that I'm getting new scales would have lost me the color)

I didn't have acetone so I ended up boiling the scales to soften them up a bit and used a very thin nail file to get under the bolster. It seemingly worked out well but I had to re-form the metal to the scale after it was off as it bent a little.

I guess all of these are learning experiences in a first time restore.