Does using olive oil or any oil for that matter have any negative effect on your badger-haired brush? If I am applying lather directly on my beard after I apply oil then the brush will come into...