Looks like rust. To clean the scales and the razor without unpinning, spray the whole thing with WD40 especially between the scales and let sit for a few minutes.
Then clip off the end of a wooden coffee stir sick with a pair of dikes and scrape the gunk off the inside of the scales with the straight tip. Spray down again and wrap the stir stick with a paper towel and scrub between the scales. This will remove 90 percent of the soap rust and crud.
Then use pipe cleaners, flattened Qtips and dental floss to get the rest, more WD 40 and paper towel wrapped stir stick stir stick to remove the residue. Wrap the stir stick and spray the towel with Simple Green to remove the oil.
You can never get to the rust in the pivot hole with anything unless you unpin the razor, but you can get them pretty clean if you take your time.
A rotary Dremel Ez473sa Spiral Detail Abrasive Brush will clean the tang between the scales, the maroon ones are good for removing rust, finer grits will polish. You can buy an assortment for about $15.
Back in the early days of the Aids out break we were advised to wash our blood contaminated equipment with a 10% bleach solution. We never had a contamination issue by doing so.
Be careful using Alcohol on plastic and Celluloid scales, it can melt them.