Results of the 2012 NRMP Program Director Survey pot

Results of the 2012
NRMP Program Director Survey
www.nrmp.org
August 2012
Requests for permission to use these data as well as questions about the content of this
publication or the National Resident Matching Program data and reports may be directed to
Mei Liang, Director of Research, NRMP, at
Questions about the NRMP should be directed to Mona Signer, Executive Director, NRMP,
at
Suggested Citation
National Resident Matching Program, Data Release and Research Committee: Results of the
2012 NRMP Program Director Survey. National Resident Matching Program, Washington, DC.
2012.
Copyright © 2012 National Resident Matching Program.
Table of Contents
Introduction
1
NRMP Program Director Survey Results, 2012
Specialty Surveys Sent Number Responding Response Rate
Anesthesiology 191 88 46.1%
Child Neurology
104 46 44.2%
Dermatology
117 53 45.3%
Emergency Medicine
153 98 64.1%
Family Medicine
451 235 52.1%
General Surgery
530 164 30.9%
Internal Medicine

731 296 40.5%
Internal Medicine/Pediatrics
76 35 46.1%
Neurological Surgery
98 42 42.9%
Neurology
142 59 41.5%
Obstetrics and Gynecology
251 113 45.0%
Orthopaedic Surgery
161 87 54.0%
Otolaryngology
107 51 47.7%
Pathology
147 78 53.1%
Pediatrics
253 131 51.8%
Physical Medicine and Rehabilitation
56 37 66.1%
Plastic Surgery
57 27 47.4%
Psychiatry
190 88 46.3%
Radiation Oncology
85 45 52.9%
Radiology
199 88 44.2%
Transitional Year
110 49 44.5%
Vascular Surgery

35 13 37.1%
All others
127 37 29.1%
Total
4,371 1,960
44.8%
The National Resident Matching Program (NRMP) conducted
a survey of the directors of all programs participating in the
2012 Main Residency Match℠. The primary purpose of the
survey was to shed light on the factors that program directors
use in both (1) selecting applicants to interview and (2)
ranking applicants for The Match.
The survey was fielded during the 19 days between the rank
order list deadline and Match Week so that program match
outcomes would not influence respondents' answers.
The survey solicited information on:
· the number of applications received, screened, and
reviewed, as well as the number of applicants
interviewed and ranked
· the percentage of interview slots offered prior to the
November 1 release date of the Medical Student
Performance Evaluation (MSPE/Dean's Letter)
· whether the program typically interviews and ranks
specific applicant groups
· the use of test scores in considering which applicants
to interview, and
· the factors used for both interview selection and for
ranking applicants.
The overall response rate for all specialties in this report
was 44.8 percent. Transitional Year and 21 specialties with

10 or more responses are included in this report. Their
response rates are listed in the table below. Response rates
for those specialties ranged from a high of 66.1 percent for
Physical Medicine and Rehabilitation to a low of 30.9 for
General Surgery.
Numbers of responses are presented in most of the graphs.
Some graphs use data from multiple survey questions. In
those cases, different N's are listed. Numbers of applicants
ranked and positions in the Match are extracted from the
NRMP database. Graphs are suppressed for specialties
with less than five responses.
This report presents results by specialty on selected items
from the survey. The NRMP hopes that program directors,
medical school officials, and applicants find these data
useful as they prepare for and participate in The Match.
_______________
The NRMP's data reporting and research activities are
guided by its Data Release and Research Committee.
NRMP data and reports can be found at:
www.nrmp.org/data/.

All Specialties Combined
2
NRMP Program Director Survey Results, 2012

Figure 1
All Specialties
Percentage of Programs Citing Each Factor in Selecting Applicants to Interview
3
NRMP Program Director Survey Results, 2012

0% 20% 40% 60% 80% 100%
USMLE/COMLEX Step 1 score
Letters of recommendation in the specialty
Personal Statement
Grades in required clerkships
USMLE/COMLEX Step 2 score
Grades in clerkship in desired specialty
Graduate of U.S. allopathic medical school
Medical Student Performance Evaluation
(MSPE/Dean's Letter)
Class ranking/quartile
Gaps in medical education
Personal prior knowledge of the applicant
Perceived commitment to specialty
Honors in clinical clerkships
Applicant was flagged with Match violation by the
NRMP
Volunteer/extracurricular experiences
Other life experience
Honors in clerkship in desired specialty
Consistency of grades
Audition elective/rotation within your department
82%
81%
77%
71%
70%
69%
69%
68%

67%
67%
63%
63%
62%
62%
61%
61%
61%
60%
60%
N=1,666

Figure 1
All Specialties
Percentage of Programs Citing Each Factor in Selecting Applicants to Interview
(continuted)
4
NRMP Program Director Survey Results, 2012
0% 20% 40% 60% 80% 100%
Evidence of professionalism and ethics
Interpersonal skills
Perceived interest in program
Graduate of highly regarded U.S. medical school
Leadership qualities
Alpha Omega Alpha (AOA) membership
Demonstrated involvement and interest in research
Feedback from current residents
Visa status*
Honors in basic sciences

Fluency in language spoken by your patient population
Interest in academic career
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score*
Other post-interview contact
Gold Society membership
55%
55%
54%
53%
53%
51%
51%
50%
49%
45%
36%
34%
28%
27%
23%
23%
* International Medical Graduates only
N=1,666
All Specialties
Mean Importance Ratings* of Factors in Ranking Applicants

Figure 2
*Ratings on a scale from 1 (not at all important) to 5 (very important).
5

NRMP Program Director Survey Results, 2012
0 1 2 3 4 5
Applicant was flagged with Match violation by the
NRMP
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with housestaff during interview and
visit
Feedback from current residents
Evidence of professionalism and ethics
Grades in clerkship in desired specialty
Perceived commitment to specialty
Letters of recommendation in the specialty
Graduate of U.S. allopathic medical school
USMLE/COMLEX Step 1 score
Leadership qualities
Honors in clerkship in desired specialty
Gaps in medical education
Grades in required clerkships
USMLE/COMLEX Step 2 score
Honors in clinical clerkships
Class ranking/quartile
Medical Student Performance Evaluation
(MSPE/Dean's Letter)
Personal prior knowledge of the applicant
4.8
4.7
4.7
4.6
4.5

4.5
4.2
4.2
4.2
4.1
4.1
4.1
4.0
4.0
4.0
4.0
3.9
3.9
3.8
3.8
N=1,666
All Specialties
Mean Importance Ratings* of Factors in Ranking Applicants
(continuted)

Figure 2
*Ratings on a scale from 1 (not at all important) to 5 (very important).
** International Medical Graduates only
6
NRMP Program Director Survey Results, 2012
0 1 2 3 4 5
Consistency of grades
Perceived interest in program
Visa status**
Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school
Alpha Omega Alpha (AOA) membership
Fluency in language spoken by your patient
population
Personal Statement
Other life experience
Demonstrated involvement and interest in research
Honors in basic sciences
Volunteer/extracurricular experiences
USMLE/COMLEX Step 3 score**
Other post-interview contact
Interest in academic career
Gold Society membership
Second interview/visit
Away rotation in your specialty at another
institution
3.8
3.7
3.7
3.7
3.6
3.4
3.3
3.3
3.2
3.1
3.0
3.0
3.0
2.8

2.8
2.8
2.6
2.4
N=1,666
0%
20%
40%
60%
80%
100%
Yes, pass only Yes, target score No
33%
48%
20%
Scores required?
All Specialties
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure 3
Percentage of Programs That Use USMLE Step 1 Score
Percentage of Programs That Use USMLE Step 2 (CK) Score
7
NRMP Program Director Survey Results, 2012
0%
20%
40%
60%
80%
100%

Yes, pass only Yes, target score No
36%
63%
1%
Scores required?
0%
20%
40%
60%
80%
100%
Never Seldom Often
26%
61%
13%
Would your program consider applicants who fail their
exam on the 1st attempt?
0%
20%
40%
60%
80%
100%
Never Seldom often
32%
59%
8%
Would your program consider applicants who fail their
exam on the 1st attempt?
N=1,844

N=1,494
N=1,771 N=1,303
N=506N=689N=997
USMLE Step 1 and Step 2 CK Scores
Programs Consider When Granting Interviews
N=708
100
120
140
160
180
200
220
240
260
280
Scores Below Which Programs
Generally Does Not Grant Interviews
100
120
140
160
180
200
220
240
260
280
Scores Above Which Programs
Almost Always Grant Interviews

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in thebox is the median. The x-shaped symbol in the box is the mean.
USMLE Step 2 CKUSMLE Step 1USMLE Step 2 CKUSMLE Step 1
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%
8%
71%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%

Yes, pass only Yes, target score No
42%
35%
23%
COMLEX-USA Level 1*
N=76
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only No
77%
23%
USMLE Step 2 Clinical Skills (CS)
0%
10%
20%
30%
40%
50%
60%
70%
80%

90%
100%
Yes, pass only Yes, target score No
39%
29%
32%
COMLEX-USA Level 2-CE*
N=53
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%
10%
69%
USMLE Step 3
0%
10%
20%
30%
40%
50%

60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
55%
10%
35%
COMLEX-USA Level 2-PE*
N=1,262
N=1,212
N=1,166
N=878
* Osteopathic applicants only

Figure 4
All Specialties
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
N=1,705
N=1,138
8
NRMP Program Director Survey Results, 2012
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
0%
10%
20%

30%
40%
50%
60%
70%
80%
90%
100%
U.S. Senior U.S. Grad Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
98%
73%
73%
55%
42%
63%
52%
Percentage of Programs that Typically Interview and Rank Each Applicant Groups
All Specialties
Program's Interview Activities
Figure 5
9
NRMP Program Director Survey Results, 2012
0%
10%
20%
30%
40%
50%
0% 1-24% 25-49% 50-74% 75-99% 100%
25%

12%
11%
16%
26%
10%
Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date
0
100
200
300
400
500
600
700
800
Number of
applications
received
Number of
applicants
interviewed
Number of
applicants
ranked
Number of
postions in The
Match
765
89
66

7
Average Number of Applications Received, Applicants
Interviewed and Ranked and Positions in The Match
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applications
rejected without an interview
Percentage of applicants
receiving an interview
53%
46%
Average Percentage of Applications Interviewed
N=1,836
N=1,844 N=1,849
N=1,868
37% of all programs consider all applicants

Anesthesiology
(N=88)
NRMP Program Director Survey Results, 2012
10

Figure AN-1
Anesthesiology
Percentage of Programs Citing Each Factor in Selecting Applicants to Interview
0% 20% 40% 60% 80% 100%
USMLE/COMLEX Step 1 score
Letters of recommendation in the specialty
Personal Statement
Grades in required clerkships
USMLE/COMLEX Step 2 score
Grades in clerkship in desired specialty
Graduate of U.S. allopathic medical school
Medical Student Performance Evaluation
(MSPE/Dean's Letter)
Class ranking/quartile
Gaps in medical education
Personal prior knowledge of the applicant
Perceived commitment to specialty
Honors in clinical clerkships
Applicant was flagged with Match violation by the
NRMP
Volunteer/extracurricular experiences
Other life experience
Honors in clerkship in desired specialty
Consistency of grades
Audition elective/rotation within your department
84%
88%
82%
82%

72%
72%
74%
72%
84%
74%
66%
66%
76%
69%
70%
73%
70%
76%
73%
N=74
NRMP Program Director Survey Results, 2012
11

Figure AN-1
Anesthesiology
Percentage of Programs Citing Each Factor in Selecting Applicants to Interview
(continued)
0% 20% 40% 60% 80% 100%
Evidence of professionalism and ethics
Interpersonal skills
Perceived interest in program
Graduate of highly regarded U.S. medical school
Leadership qualities
Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research
Feedback from current residents
Visa status*
Honors in basic sciences
Fluency in language spoken by your patient population
Interest in academic career
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score*
Other post-interview contact
Gold Society membership
58%
53%
65%
61%
53%
69%
49%
50%
54%
61%
32%
28%
15%
26%
28%
34%
N=74
* International Medical Graduates only
NRMP Program Director Survey Results, 2012
12

Anesthesiology
Mean Importance Ratings* of Factors in Ranking Applicants

Figure AN-2
0 1 2 3 4 5
Applicant was flagged with Match violation by the
NRMP
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with housestaff during interview and
visit
Feedback from current residents
Evidence of professionalism and ethics
Grades in clerkship in desired specialty
Perceived commitment to specialty
Letters of recommendation in the specialty
Graduate of U.S. allopathic medical school
USMLE/COMLEX Step 1 score
Leadership qualities
Honors in clerkship in desired specialty
Gaps in medical education
Grades in required clerkships
USMLE/COMLEX Step 2 score
Honors in clinical clerkships
Class ranking/quartile
Medical Student Performance Evaluation
(MSPE/Dean's Letter)
Personal prior knowledge of the applicant
4.9
4.7

4.7
4.6
4.4
4.6
4.2
4.0
3.9
4.2
4.2
4.0
4.1
4.2
4.2
4.0
4.2
4.3
3.9
3.8
N=74
*Ratings on a scale from 1 (not at all important) to 5 (very important).
NRMP Program Director Survey Results, 2012
13

Figure AN-2
Anesthesiology
Mean Importance Ratings* of Factors in Ranking Applicants
(continued)
0 1 2 3 4 5
Consistency of grades
Perceived interest in program

Visa status**
Audition elective/rotation within your department
Graduate of highly regarded U.S. medical school
Alpha Omega Alpha (AOA) membership
Fluency in language spoken by your patient
population
Personal Statement
Other life experience
Demonstrated involvement and interest in
research
Honors in basic sciences
Volunteer/extracurricular experiences
USMLE/COMLEX Step 3 score**
Other post-interview contact
Interest in academic career
Gold Society membership
Second interview/visit
Away rotation in your specialty at another
institution
4.0
3.7
3.6
3.6
3.7
3.8
3.1
3.1
3.3
3.0
3.5

2.8
3.0
2.6
2.8
2.7
2.3
2.1
N=74
*Ratings on a scale from 1 (not at all important) to 5 (very important).
** International Medical Graduates only
NRMP Program Director Survey Results, 2012
14
100
120
140
160
180
200
220
240
260
280
Anesthesiology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure AN-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%

30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
35%
62%
3%
Would your program consider applicants who fail
their exam on the 1st attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
51%
49%
0%
Would your program consider applicants who fail

their exam on the 1st attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18%
82%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%

57%
26%
Scores required?
N=87
N=69
N=81
N=61
N=46N=64 N=48 N=36
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
100
120
140
160
180
200
220
240
260
280
USMLE Step 2 CKUSMLE Step 1
USMLE Step 1
USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs
Almost Always Grant Interviews
Scores Below Which Programs
Generally Does Not Grant Interviews

NRMP Program Director Survey Results, 2012
15
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
54%
17%
COMLEX-USA Level 1*
N=76
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%

Yes, pass only No
67%
33%
USMLE Step 2 CS
Anesthesiology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure AN-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
31%
39%
COMLEX-USA Level 2-CE*
N=53
0%
10%
20%
30%
40%

50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%
11%
68%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
3%
69%
COMLEX-USA Level 3*
0%
10%
20%

30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
53%
4%
43%
COMLEX-USA Level 2-PE*
N=76 N=53
N=59
N=51
N=47 N=35
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2012
16
0%
10%
20%
30%
40%
50%
60%

70%
80%
90%
100%
100%
84%
83%
54%
45%
68%
52%
U.S. Senior U.S. Grad Osteopathic Canadian
Fifth Pathway
U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Groups
Figure AN-5
Anesthesiology
Program's Interview Activities
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
0% 1-24% 25-49% 50-74% 75-99% 100%

7%
8%
17%
22%
37%
8%
Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date
0
100
200
300
400
500
600
700
800
900
1,000
Number of
applications
received
Number of
applicants
interviewed
Number of
applicants ranked
Number of
positions in The
Match
719

117
98
8
Average Number of Applications Received, Applicants
Interviewed and Ranked and Positions in The Match
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applications
rejected
Percentage of applicants
receiving an interview
48%
46%
Average Percentage of Applications Rejected and
Reviewed
N=86
N=86N=83N=88*N=88*N=86N=86
N=87
39% of Anesthesiology programs consider all applicants
* Data from the NRMP database
NRMP Program Director Survey Results, 2012

17

Child Neurology
(N=46)
NRMP Program Director Survey Results, 2012
18

Figure CN-1
Child Neurology
Percentage of Programs Citing Each Factor in Selecting Applicants to Interview
0% 20% 40% 60% 80% 100%
USMLE/COMLEX Step 1 score
Letters of recommendation in the specialty
Personal Statement
Grades in required clerkships
USMLE/COMLEX Step 2 score
Grades in clerkship in desired specialty
Graduate of U.S. allopathic medical school
Medical Student Performance Evaluation
(MSPE/Dean's Letter)
Class ranking/quartile
Gaps in medical education
Personal prior knowledge of the applicant
Perceived commitment to specialty
Honors in clinical clerkships
Applicant was flagged with Match violation by the
NRMP
Volunteer/extracurricular experiences
Other life experience
Honors in clerkship in desired specialty

Consistency of grades
Audition elective/rotation within your department
78%
88%
73%
66%
54%
71%
49%
80%
73%
68%
66%
73%
61%
66%
56%
61%
61%
63%
66%
N=41
NRMP Program Director Survey Results, 2012
19

Figure CN-1
Child Neurology
Percentage of Programs Citing Each Factor in Selecting Applicants to Interview
(continued)
0% 20% 40% 60% 80% 100%

Evidence of professionalism and ethics
Interpersonal skills
Perceived interest in program
Graduate of highly regarded U.S. medical school
Leadership qualities
Alpha Omega Alpha (AOA) membership
Demonstrated involvement and interest in research
Feedback from current residents
Visa status*
Honors in basic sciences
Fluency in language spoken by your patient population
Interest in academic career
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score*
Other post-interview contact
Gold Society membership
59%
56%
51%
56%
51%
46%
54%
39%
59%
49%
44%
46%
32%
39%

32%
17%
N=41
* International Medical Graduates only
NRMP Program Director Survey Results, 2012
20
Child Neurology
Mean Importance Ratings* of Factors in Ranking Applicants

Figure CN-2
0 1 2 3 4 5
Applicant was flagged with Match violation by the
NRMP
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with housestaff during interview and
visit
Feedback from current residents
Evidence of professionalism and ethics
Grades in clerkship in desired specialty
Perceived commitment to specialty
Letters of recommendation in the specialty
Graduate of U.S. allopathic medical school
USMLE/COMLEX Step 1 score
Leadership qualities
Honors in clerkship in desired specialty
Gaps in medical education
Grades in required clerkships
USMLE/COMLEX Step 2 score
Honors in clinical clerkships

Class ranking/quartile
Medical Student Performance Evaluation
(MSPE/Dean's Letter)
Personal prior knowledge of the applicant
4.8
4.6
4.7
4.5
4.4
4.4
4.3
4.3
4.4
3.6
4.1
4.1
4.1
3.8
3.8
4.1
3.8
3.8
4.1
4.1
N=41
*Ratings on a scale from 1 (not at all important) to 5 (very important).
NRMP Program Director Survey Results, 2012
21

Figure CN-2

Child Neurology
Mean Importance Ratings* of Factors in Ranking Applicants
(continued)
0 1 2 3 4 5
Consistency of grades
Perceived interest in program
Visa status**
Audition elective/rotation within your department
Graduate of highly regarded U.S. medical school
Alpha Omega Alpha (AOA) membership
Fluency in language spoken by your patient
population
Personal Statement
Other life experience
Demonstrated involvement and interest in
research
Honors in basic sciences
Volunteer/extracurricular experiences
USMLE/COMLEX Step 3 score**
Other post-interview contact
Interest in academic career
Gold Society membership
Second interview/visit
Away rotation in your specialty at another
institution
3.6
4.0
4.0
3.9
3.6

3.4
3.7
3.6
3.3
3.5
3.2
3.1
3.5
3.4
3.5
2.7
3.1
2.8
N=41
*Ratings on a scale from 1 (not at all important) to 5 (very important).
** International Medical Graduates only
NRMP Program Director Survey Results, 2012
22