I'm quite sure that a poultice would remove the oil.
Here is a link for a poultice to remove oil from granite. I've used this and it works very well!

http://www.onlinetips.org/granite-countertops