Objective　The empirical validity of the National Medical Licensing Examination (NMLE) has rarely been studied. This is one of the first studies comparing NMLE and annual assess-ment scores. This study provided the criterion-related validity evidence for the NMLE. The NMLE can be used to test the abilities and skills of physicians. Method　We evaluated the test 163 residents in 12 medical school-affiliated hospitals who had finished their first year of training and had taken the NMLE and an annual skills assessment. We used Pearson correlations to estimate the relationship be-tween NMLE scores and annual assessment scores. Results　A total of 163 residents met inclusion requirements. Correlations between NMLE scores and annual assessment scores ranged from 0.300 to 0.843. Conclusions　The criterion-related validity of NMLE was high

so it can be use to evaluate the residents clinical competence indeed.