A core competency-based objective structured clinical examination (OSCE) can predict future resident performance.

Department of Emergency Medicine, Emory University School of Medicine, Atlanta, GA. USA.
Academic Emergency Medicine (Impact Factor: 1.76). 10/2010; 17 Suppl 2:S67-71. DOI:10.1111/j.1553-2712.2010.00894.x
Source: PubMed

ABSTRACT This study evaluated the ability of an objective structured clinical examination (OSCE) administered in the first month of residency to predict future resident performance in the Accreditation Council for Graduate Medical Education (ACGME) core competencies.
Eighteen Postgraduate Year 1 (PGY-1) residents completed a five-station OSCE in the first month of postgraduate training. Performance was graded in each of the ACGME core competencies. At the end of 18 months of training, faculty evaluations of resident performance in the emergency department (ED) were used to calculate a cumulative clinical evaluation score for each core competency. The correlations between OSCE scores and clinical evaluation scores at 18 months were assessed on an overall level and in each core competency.
There was a statistically significant correlation between overall OSCE scores and overall clinical evaluation scores (R = 0.48, p < 0.05) and in the individual competencies of patient care (R = 0.49, p < 0.05), medical knowledge (R = 0.59, p < 0.05), and practice-based learning (R = 0.49, p < 0.05). No correlation was noted in the systems-based practice, interpersonal and communication skills, or professionalism competencies.
An early-residency OSCE has the ability to predict future postgraduate performance on a global level and in specific core competencies. Used appropriately, such information can be a valuable tool for program directors in monitoring residents' progress and providing more tailored guidance.

0 0
  • [show abstract] [hide abstract]
    ABSTRACT: Background and objectives The purpose of this paper is to describe the use of resident performance on an observed structured clinical examination (OSCE) as a tool to refine a mood disorders curriculum, and to disseminate a mood disorders OSCE for use in other residency settings. Methods A depression-focused OSCE and a direct observation evaluation tool were developed and implemented. A total of 24 first-year family medicine residents (PGY1) participated in the OSCE, and their performance was used to direct changes in a mood disorders curriculum. Results Residents performed well on general interview behaviours, and 67% were able to uncover depression in a patient presenting with headaches. Less than 50% of the residents asked about suicidal ideation and recreational drug use. Curriculum was added that addressed the latter deficiencies. Conclusions Tracking of resident performance on specific behaviours during OSCE sessions can be used for curriculum evaluation purposes. The mood disorders curriculum in additional family medicine residency programmes can now be evaluated using our depression-focused OSCE and Clinical Performance Checklist.
    Mental Health in Family Medicine 01/2013; 10(1):45-51.
  • [show abstract] [hide abstract]
    ABSTRACT: In 2012, the Accreditation Council for Graduate Medical Education (ACGME) designated ultrasound (US) as one of 23 milestone competencies for emergency medicine (EM) residency graduates. With increasing scrutiny of medical educational programs and their effect on patient safety and health care delivery, it is imperative to ensure that US training and competency assessment is standardized. In 2011, a multiorganizational committee composed of representatives from the Council of Emergency Medicine Residency Directors (CORD), the Academy of Emergency Ultrasound of the Society for Academic Emergency Medicine (SAEM), the Ultrasound Section of the American College of Emergency Physicians (ACEM), and the Emergency Medicine Residents' Association was formed to suggest standards for resident emergency ultrasound (EUS) competency assessment and to write a document that addresses the ACGME milestones. This article contains a historical perspective on resident training in EUS and a table of core skills deemed to be a minimum standard for the graduating EM resident. A survey summary of focused EUS education in EM residencies is described, as well as a suggestion for structuring education in residency. Finally, adjuncts to a quantitative measurement of resident competency for EUS are offered.
    Academic Emergency Medicine 07/2013; 20(7):740-5. · 1.76 Impact Factor
  • [show abstract] [hide abstract]
    ABSTRACT: New residents enter emergency medicine (EM) residency programs with varying EM experiences, which makes residency orientation programs challenging to design. There is a paucity of literature to support best practices. We report on a curriculum development project for EM residency orientation using the Kern Model. Components of the revised curriculum include administrative inculcation into the program; delivering skills and knowledge training to ensure an entering level of competence; setting expectations for learning in the overall residency curriculum; performing an introductory performance evaluation; and socialization into the program. Post-implementation resident surveys found the new curriculum to be helpful in preparing them for the first year of training. The Kern Model was a relevant and useful method for redesigning a new-resident orientation curriculum.
    Journal of Emergency Medicine 01/2014; · 1.33 Impact Factor