As I understood it the damage, doing circles, comes from the hard beard hairs. I assume it's pretty safe to load a brush on either a soap puck or a tub of cream using circles.

BUT your circles...