If it doesn't affect the shave, I would leave it alone. I for on a have mild OCD so if I were to notice the issue I wouldn't be able to tolerate it.
It may be due to the grind. One wheel removed...