I usually just buff them with white jewelers rouge, just like finishing my razors. I've had good results. If the scales are really rough, I'll sand them with 220 grit then 360 grit then buff.