I see no problem with it... other than the antlers would get in my way, personally.

Just clean it well after use, and you probably won't have problems. YMMV