If your worried about the sponge stop using it and see what happens. You can just wipe the edge on a towel to clean it during and after the shave if your worried about hitting the sink or faucet. Unless you are using some industrial use sponge I doubt that is your issue. You can always buy a natural sponge too. Could be you are dulling the edge on the sponge.