For going against the grain, you should be holding the blade _almost flat_ against your skin.

If you use the same blade angle as you do for with the grain, the beard hairs will catch the razor and...