I don't think it will hurt it. I keep what is left of a 1kg block of shave soap in the deep freeze. When I need more I cut a frozen piece off, let thaw and use it. Chances are you will be OK.

Bob