Put a couple globs of hot glue on the tang and press on a flat surface as it hardens. Once cool and hard, use a file to fine tune the compound angle you need to drill the hole straight.

A chisel...