A lot of the irritation will go away once you get some consistency with your blade angle (it's probably too much and needs to be shallower). Also, as you get more efficient, you'll be cutting more beard with less passes over the same patch of skin. Pull the skin on your face tight so that the hairs stand up as best as you can. After a few shaves it will start feeling better.

Good luck and happy shaves!