I think you'd be better off using something oil-based on leather, and something water-based on fabric.