Sounds like you have a blade centering problem, sometimes this can be fixed with adjusting the pins, Blade Centering - Straight Razor Place Library

Just realize we are talking about a Gold Dollar...