If you look at the blade from the toe end down the spine you will notice the blade is canted towards one side. The concave side bends towards your face and that's why shaving with the other side feels unnatural. It is unnatural. Honing a japanese razor is not like honing a western razor. The usual method is using a 12K hone and doing back and forth strokes with a 2:1 ratio with more strokes on the shaving side and using pressure as you hone. The real art comes in knowing how much pressure to use. Alternatively you can use a diamond pasted strop .50. Same ratio but not back and forth of course.

Your razor just isn't sharp.