How about silicone caulking? It will hold it in place, but if you want to remove it, it should peel off both the plaque and the razor.