In the end there are no rules, no real "proper" way. You have to do what's comfortable for you. So if that means you only switch hands for certain portions of your face (as opposed to uniformly)...