Not at all. A second or third pass is not at all unusual.

Normally I'll do one pass with the grain, and at least a second that's mostly across and partly against the grain (it took me about three years to figure out how to maximize my second pass, so be patient...) and if I'm in the mood or have the time, a third against the grain.

That having been said, result of any and all passes will improve with practice and improved prep and technique.