I've actually found that moving my hand down the contour of my chin is much more difficult than placing my razor above my chin and using my mouth to stretch the skin in such a way that the skin moves beneath the razor. This effectively makes that challenging turn without even moving the razor (and it works really well for me.

I have no idea if I explained that in a way that makes sense, but it works for me