Good advice above. Don't think of the wedge as separate from the scales. It's all part of the same handle and should be worked as one piece, at least near the finishing stages.
If the wedge still bothers you, you could skip it and go "wedgeless". It's a real exercise in frustration.
http://straightrazorpalace.com/attac...e-img_9868.jpg
Phillip