OK I have to agree with some of the above posts, if I am understanding what you have written you are using Barbers hones to refresh on a regular basis.. This might lead to an overhoned or too fine an edge... Or possibly you do need to go to a heavier grind razor... If it were me I would stay away from trying to get to fine an edge on the razor, and stay with this progression... establish your bevel using electrcal tape on the spine( gives a slightly steeper bevel ie: stronger) then a 4k grit stone to sharpen that bevel, then go to a 8k grit for polishing... Then a linen strop then a leather strop, and stop there... (no tape for stropping) Try this and see how the edge holds up... If this still doesnt work then it might be time for a different razor with a heavier grind or maybe SS or a "Ice" hardened edge....
Hope that helps out and welcome to SRP