Dont worry if the felt gets dirty, it wont change it's ability to polish, it's more an indication of the ammount of material being removed.

I have two felt wheels that are as black as the ace of...