I find face lathering a bit more exfoliating since it is on my face longer. Maybe try a soap you have used before with no irritation and try to narrow things down a bit as to what it could be.