Silvo or chrome polish are safe for a straight razor?

Do you do anything to clean the silvo off when you're done in order to avoid facial contamination?

This will make polishes /much/ easier to...