I have a beard like yours. Use the straight at a shallower angle than the Feather. Stop using the feather as it is reinforcing the wrong angle. Try this, it worked for me:

Take the first pass...