Having never owned a collet chuck before I don't know if this is a milling defect or the way it's supposed to be. The internal flange on the chuck is milled off-center. I know the flange is what holds the collet in place and think it might be off-center to allow easy removal of the collet.
Thanks,
Dave