Usage of the National Board of Medical Examiners Subject Test in Psychiatry by U.S. and Canadian Clerkships

Texas A&M University - Galveston, Galveston, Texas, United States
Academic Psychiatry (Impact Factor: 0.81). 02/2005; 29(1):52-7. DOI: 10.1176/appi.ap.29.1.52
Source: PubMed


The authors explored psychiatry clerkship usage of the National Board of Medical Examiners (NBME) Subject Test.
U.S. and Canadian psychiatry clerkship directors (N=150) were sent an 18-item questionnaire surveying evaluation and remediation practices.
Of 111 questionnaires (74%) returned, 76 (69%) reported using the NBME Subject Test. As part of the overall grade, the test was granted a mean weight of 31% and a median weight of 25%. Of 72 clerkship directors who use the test for grading, 42% convert the percentile score and 38% convert the subject score. Of 60 clerkship directors who use the test for passing, 72% convert the raw score (mean=58.3, median=58), and 28% convert the percentile score (mean=12.2(th), median=11(th) percentile).
Most psychiatry clerkship directors use the NBME Subject Test, but no predominant method exists for weighing the test or converting it into a grade.

15 Reads
  • [Show abstract] [Hide abstract]
    ABSTRACT: The authors explored the time that is currently devoted to psychiatry clerkships to determine whether "shortened" clerkships differ in course director satisfaction and evaluation strategies. An 18-item questionnaire was sent to 150 U.S. and Canadian clerkship directors. The return rate was 74% (111 questionnaires). Clerkship length ranged from 4 to 8 weeks, with 6 weeks being most common (49.5% of clerkships). Only 18.9% had clerkships lasting 8 full weeks. Shorter clerkships were more likely to rely on the NBME subject test, and less likely to rely on Objective Standardized Clinical Examinations (OSCEs) or oral examinations. Most clerkship directors (81.9%) felt their evaluation procedures reflected their clerkship objectives. Among those who did not or were not sure, a majority (77.7%) felt having too few weeks was among the causes, except for 8-week clerkship directors, who did not mention clerkship length as an issue. The number of clerkships having 2 full months devoted to psychiatry has decreased in recent years. Shorter clerkships rely heavily on the National Board of Medical Examiners (NBME) Subject Examination as an evaluation tool, testing for book knowledge rather than clinical skills.
    No preview · Article · Feb 2005 · Academic Psychiatry
  • [Show abstract] [Hide abstract]
    ABSTRACT: The authors investigate whether the timing of the psychiatry clerkship influences scores on the National Board of Medical Examiners (NBME) subject exam as has been reported for other clerkships. The authors attempt to identify which clerkships, if any, offer an advantage when taken before psychiatry. Mean aggregate exam scores over 4 years were calculated according to clerkship sequence. An analysis of variance was conducted to assess the effect of sequence on test scores. Pairwise comparisons (t tests) were performed to determine whether students who completed one particular clerkship before psychiatry scored higher on the subject examination than students who completed the clerkship after psychiatry. Students who take psychiatry near the end of the clerkship sequence score higher than students who take psychiatry as a first clerkship. The differences are small but significant. The mean score for students taking psychiatry first was 72.81, compared to a score of 78.51 for students taking the clerkship last. No single clerkship is more likely than another to increase test scores when taken before psychiatry. Clerkship directors must be aware of the timing bias in subject exam scores. However, the bias may not be sufficient to justify abandoning use of the subject examinations.
    No preview · Article · Apr 2006 · Academic Psychiatry
  • [Show abstract] [Hide abstract]
    ABSTRACT: Universally, clerkship grading is diverse and not standardized. The authors' faculty was troubled by the inability to provide meaningful evaluations, as more than 60% of students received the highest grade. Although a psychiatry clerkship mandate of a faculty-observed student clinical interview existed for several years, the majority of students reported not completing the interview under direct observation by a faculty member, and no meaningful feedback or evaluation for this activity existed. In order to create diversity in grading criteria and to examine clinical skills more thoroughly than previously, written and oral examinations were developed and supervised interviews of patients and written comprehensive psychiatric evaluations were added. A core group of department faculty was instructed in the use of materials and instruments designed to standardize the experiences and the student evaluations. Adding a wider diversity of experiences and evaluations to the clerkship, particularly assessment of interviewing skills, oral exams, and evaluation of comprehensive histories, has resulted in a more divergent spread of grades. Clerkship grades can be effectively computed using various methods to examine knowledge and clinical skills. The addition of new methods of evaluation has added specificity to the performance feedback provided to the students completing the psychiatric clerkship. These changes have been viewed positively by department faculty and medical students. While requiring further refinement, they may eventually provide data to identify students requiring special attention in specific cognitive, relational, and clinical skill areas.
    No preview · Article · Apr 2006 · Academic Psychiatry
Show more