That works - I've had to resort to that technique before as well.
A hand held microreamer to enlarge the washer hole is easier (ream a bit from each side of the washer). And you can hold the washer with vice grips while you ream it.
Dremel makes a small reamer bit, but every time I've tried it on something small, it ripped the washer apart.