Yes, they must be darn close to fitting on the collet. If you crank down too much to make it fit something too large they WILL break!
Ask me how I know? :D

Seems there are some with a fairly...