The DE is beneficial because it makes you learn proper beard prep.
If over the counter pre shave oils irritate your skin, try olive oil. just a few drops will do.
What soap are you using? if your soap is sub-standard your shaves will be too.
Allow the lather to sit for more than a minute, put it on, and find another task to work on for a couple of minutes, then relather and do your WTG pass.
Try doing several WTG passes for now, and forego the ATG until you can get a nice clean shave doing only WTG. (You can get very close to BBS just going WTG with enough practise)
Pay close attention to your angles, they can make a world of difference.
I get pulling when I go ATG on my upper lip, I always have, with a Mach 3 a straight even a feather. I have to work up to going ATG by doing several passes, and removing 99% of the hair before I do my ATG there.
I have a spot on my chin that is similar.
This is not unheard of, you just need to build your skills and work up to a skill level where you are ready to go against the grain. Some people are fortunate enough to do this quickly, others take longer, there is nothing to be ashamed about.