Most everyone has a problem with that area when they start. It comes down to practise and technique and will slowly come together for you. Another issue can be your stropping. That can make a big difference to the quality of your shave, and something that takes time to master. It is a good thing to respect the blade and use light pressure. Nothing wrong with cleaning up with your DE while you learn, best of luck.