I have had exactly the same problem with my wood.

I tried the first time using a dremmel with a sandpaper drum. The wood looked like a roller coaster.
I've tried by hand and decided it was taking...