If I understood correctly, buffer wheels are made with cotton loops.
Why not use felt wheels?

EDIT: good thing you were wearing gloves. otherwise the tips could have gone completely.