I'd either get it re pinned or use a piece of paper folded over the back.
Make the paper a good bit longer than your blade is. Kind of like here.