I have the same problem going ATG on my neck.
The left side of my adams apple I have an area that has a small swirl of hair which shaves fine WTG but ATG causes irritation like no other. Regardless...