Cerium oxide cuts very slowly, so, the felt would not be ideal. You can use the rough leather, and, don't worry about unevenness. After some passes, it will disperse.
As for the oil, vegetable oil...