Ballistol is a great product and it will soften and preserve leather.

Any oil has the potential to raise the grain of a leather strop leaving it feeling fuzzy, furry, or velvety. In my opinion...