How fine are you sanding the scales before you start applying the finish? If you go much higher than 320 or 400, the CA won't stick very well.

Also, it's best to always drill through CA from the...