Article

A core competency-based objective structured clinical examination (OSCE) can predict future resident performance.

Department of Emergency Medicine, Emory University School of Medicine, Atlanta, GA. USA.
Academic Emergency Medicine (Impact Factor: 2.2). 10/2010; 17 Suppl 2:S67-71. DOI: 10.1111/j.1553-2712.2010.00894.x
Source: PubMed

ABSTRACT This study evaluated the ability of an objective structured clinical examination (OSCE) administered in the first month of residency to predict future resident performance in the Accreditation Council for Graduate Medical Education (ACGME) core competencies.
Eighteen Postgraduate Year 1 (PGY-1) residents completed a five-station OSCE in the first month of postgraduate training. Performance was graded in each of the ACGME core competencies. At the end of 18 months of training, faculty evaluations of resident performance in the emergency department (ED) were used to calculate a cumulative clinical evaluation score for each core competency. The correlations between OSCE scores and clinical evaluation scores at 18 months were assessed on an overall level and in each core competency.
There was a statistically significant correlation between overall OSCE scores and overall clinical evaluation scores (R = 0.48, p < 0.05) and in the individual competencies of patient care (R = 0.49, p < 0.05), medical knowledge (R = 0.59, p < 0.05), and practice-based learning (R = 0.49, p < 0.05). No correlation was noted in the systems-based practice, interpersonal and communication skills, or professionalism competencies.
An early-residency OSCE has the ability to predict future postgraduate performance on a global level and in specific core competencies. Used appropriately, such information can be a valuable tool for program directors in monitoring residents' progress and providing more tailored guidance.

0 Bookmarks
 · 
125 Views
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background and objectives The purpose of this paper is to describe the use of resident performance on an observed structured clinical examination (OSCE) as a tool to refine a mood disorders curriculum, and to disseminate a mood disorders OSCE for use in other residency settings. Methods A depression-focused OSCE and a direct observation evaluation tool were developed and implemented. A total of 24 first-year family medicine residents (PGY1) participated in the OSCE, and their performance was used to direct changes in a mood disorders curriculum. Results Residents performed well on general interview behaviours, and 67% were able to uncover depression in a patient presenting with headaches. Less than 50% of the residents asked about suicidal ideation and recreational drug use. Curriculum was added that addressed the latter deficiencies. Conclusions Tracking of resident performance on specific behaviours during OSCE sessions can be used for curriculum evaluation purposes. The mood disorders curriculum in additional family medicine residency programmes can now be evaluated using our depression-focused OSCE and Clinical Performance Checklist.
    Mental Health in Family Medicine 01/2013; 10(1):45-51.
  • [Show abstract] [Hide abstract]
    ABSTRACT: Objectively structured clinical examinations (OSCEs) are widely used in medical education, but we know of none described that are specifically for nephrology fellowship training. OSCEs use simulation to educate and evaluate. We describe a technically simple, multidisciplinary, low-cost OSCE developed by our program that contains both examination and training features and focuses on management and clinical knowledge of rare hemodialysis emergencies. The emergencies tested are venous air embolism, blood leak, dialysis membrane reaction, and hemolysis. Fifteen fellows have participated in the OSCE as examinees and/or preceptors since June 2010. All have passed the exercise. Thirteen responded to an anonymous survey in July 2013 that inquired about their confidence in managing each of the 4 tested emergencies pre- and post-OSCE. Fellows were significantly more confident in their ability to respond to the emergencies after the OSCE. Those who subsequently saw such an emergency reported that the OSCE experience was somewhat or very helpful in managing the event. The OSCE tested and trained fellows in the recognition and management of rare hemodialysis emergencies. OSCEs and simulation generally deserve greater use in nephrology subspecialty training; however, collaboration between training programs would be necessary to validate such exercises.
    American Journal of Kidney Diseases 01/2014; · 5.29 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: New residents enter emergency medicine (EM) residency programs with varying EM experiences, which makes residency orientation programs challenging to design. There is a paucity of literature to support best practices. We report on a curriculum development project for EM residency orientation using the Kern Model. Components of the revised curriculum include administrative inculcation into the program; delivering skills and knowledge training to ensure an entering level of competence; setting expectations for learning in the overall residency curriculum; performing an introductory performance evaluation; and socialization into the program. Post-implementation resident surveys found the new curriculum to be helpful in preparing them for the first year of training. The Kern Model was a relevant and useful method for redesigning a new-resident orientation curriculum.
    Journal of Emergency Medicine 01/2014; · 1.33 Impact Factor

Full-text (2 Sources)

Download
0 Downloads
Available from
Dec 17, 2014