I have a goatee as well, and find that if you slow down, you'll be golden. I also start my XTG stroke at the goatee usually, so I don't accidentally take that too far. Then I come back and trim it up.

Another thing to note: I trim with a round point. A square point is not necessary...just get familiar with your blade and you'll learn what parts shave and what parts don't.