Sounds to me like the bevel is NOT set on that blade. I would take it to a lower grit to set the bevel before going back to the 4000. You can polish the edge out all you want, but unless the bevel is good, you won't be shaving with it.
Do you have a lower grit stone to use for bevel setting?