The soap is getting into your pores on the second shave and causing discomfort. When learning, I did this once where I used castile soap as my shaving soap and figured I could revist the shave later...