I don't think it has anything to do with the skin "recovering" but a shave might be closer with a little more hair on the face to serve as weight to pull itself down while shaving (or not)

I generally shave every day but sometimes I use a DE and sometimes I use a straight. I seem to get a slightly better straight razor shave when I let the facial hair get a little longer.