Exactly what I think too. I do a daily 3 pass shave but that is me. You also might find as your technique improves the irritation level might subside too. I would just do as my face tells me to do.
...