Depends on how you removed the oil, I suppose?

But I'm wondering if maybe your lather was a little dry? That happened to me my first time making real lather. It was on the dry side and the blade...