I say keep at it. If you're making progress already then just take your time, pay attention to and enjoy the sensations from shaving with your off hand. You should be fully comfortable soon.