Usage of the National Board of Medical Examiners Subject Test in Psychiatry by U.S. and Canadian clerkships.
ABSTRACT The authors explored psychiatry clerkship usage of the National Board of Medical Examiners (NBME) Subject Test.
U.S. and Canadian psychiatry clerkship directors (N=150) were sent an 18-item questionnaire surveying evaluation and remediation practices.
Of 111 questionnaires (74%) returned, 76 (69%) reported using the NBME Subject Test. As part of the overall grade, the test was granted a mean weight of 31% and a median weight of 25%. Of 72 clerkship directors who use the test for grading, 42% convert the percentile score and 38% convert the subject score. Of 60 clerkship directors who use the test for passing, 72% convert the raw score (mean=58.3, median=58), and 28% convert the percentile score (mean=12.2(th), median=11(th) percentile).
Most psychiatry clerkship directors use the NBME Subject Test, but no predominant method exists for weighing the test or converting it into a grade.
[Show abstract] [Hide abstract]
ABSTRACT: There is a lack of information regarding interventions for undergraduate students at Canadian medical schools who require remediation during their psychiatric training. The need for a theoretical framework to guide remediation has been identified. In this study, we sought to characterize remediation taking place in undergraduate psychiatry education, particularly during clerkship. A secondary goal was to ascertain whether those responsible for remediation were aware of the stages of change (transtheoretical) model, and whether they formally incorporated this framework (or another) into their remediation processes. A short six-question survey on remediation practices was e-mailed to educators responsible for undergraduate psychiatry education at all 17 Canadian medical schools as identified through the Canadian Organization of Undergraduate Psychiatry Educators (COUPE). The response rate was 67 %. Respondents' overall impressions of their school's remediation process were that it was "highly effective" (25 %), or "somewhat effective" (67 %); 8 % reported being unsure of its effectiveness. While 75 % of survey respondents were aware of the stages of change model, only 17 % reported using this framework: no alternate theoretical frameworks were reported. The most common form of evaluation was multiple-choice question (MCQ) exams, and the most common form of remediation was exam rewrites. There is little information regarding the long-term outcomes of remediation, and further research would be useful in formulating recommendations regarding best practices.Academic Psychiatry 03/2014; 38(3). DOI:10.1007/s40596-014-0099-6 · 0.81 Impact Factor
Article: Anatomy of a clerkship test.[Show abstract] [Hide abstract]
ABSTRACT: Written examinations are frequently used to assess medical student performance. Within emergency medicine (EM), a National Board of Medical Examiners (NBME) subject examination for EM clerkships does not exist. As a result, clerkship directors frequently generate examinations within their institution. This article reviews the literature behind the use of standardized examinations in evaluating medical student performance, describes methods for generating well-written test questions, reviews the statistical concepts of reliability and validity that are necessary to evaluate an examination, and proposes future directions for testing EM students.Academic Emergency Medicine 10/2010; 17 Suppl 2:S31-7. DOI:10.1111/j.1553-2712.2010.00880.x · 2.20 Impact Factor
[Show abstract] [Hide abstract]
ABSTRACT: This study aims to develop a vignette-based assessment tool for medical students on the psychiatry clerkship, with the goal of capturing knowledge and clinical reasoning. The Short-Answer Vignette Exam (SAVE), four case vignettes with open-ended questions regarding assessment, differential diagnosis, management, and treatment, was developed for and administered to medical students rotating through psychiatry at a university medical school over one academic year (n = 169). The correlation of SAVE scores to resident/faculty evaluations (clinical rating) and Shelf exam scores were analyzed. SAVE scores were significantly correlated with scores on both the Shelf and Clinical Rating. By contrast, Shelf scores were not significantly related to Clinical Rating. The SAVE may measure aspects of clinical decision making not measured by the Shelf, without being redundant in what is assessed by the Clinical Rating. The SAVE provides an additional potentially useful assessment tool to evaluate medical students on the psychiatry clerkship.Academic Psychiatry 05/2014; 38(5). DOI:10.1007/s40596-014-0150-7 · 0.81 Impact Factor