Sounds a bit like you just haven't figured out the right technique for your chin yet since it's sometimes smoother. Try to take notice and remember what you do/did the times it was smoother and try...