I have used sandpaper without issues but I'd recommend pumice stone + stiff lather.

For small nicks just rub your hand over, maybe with some mink oil

Don't worry about it

Cheers
Ivo