I have the drill press for the dremel too. For drilling use jeweler Swiss drills. They are comfortable and exactly grounded, because in the back of the fat.
Hole it always correct.