Just to throw a wrench in here.....

have you thought about a drill press? I'm asking because at Lee Valley tools you can purchase 1/2" to 2 1/2" sanding mandrels and replacement sanding...