I use my right hand for all strokes on the right side of my face, and my left hand for all strokes on the left side of my face.
On my neck I use my left hand for the right side, and my right hand for the left side except for when I'm doing a straight downward pass.
Do whatever feels right to you.