It is really hard to pinpoint where the roughness comes from.
It could be caused by a less-than-ideal shaving technique (too much pressure, too much of an angle) or it could be the sharpness or...