The 5 passes just may be it. Every time you use a straight your also exfoliating. So your irritation is likely because your doing too many passes.