Try some 2000+ grit wet and dry or pumice on it to smooth it then break it in with some lather with a glass see if it gets any better
nothing to lose