Imo its ok to shave a 3days growt. I like it my self very much. When you think i can handel this go for it.

make sure your technique is good, use a good prep before shaving (shower or pre shave creme)and take your time for the shave, dont rush.... let it be a wellnes moment of the day.
Enyoy !!