I did a similar thing when I first started - lopped off the bit of 'tache that joined to my goatee. I just learned how to use the heel and toe of the blade after that and haven't had any mishaps...