A core competency-based objective structured clinical examination (OSCE) can predict future resident performance.

Department of Emergency Medicine, Emory University School of Medicine, Atlanta, GA. USA.
Academic Emergency Medicine (Impact Factor: 2.2). 10/2010; 17 Suppl 2:S67-71. DOI: 10.1111/j.1553-2712.2010.00894.x
Source: PubMed

ABSTRACT This study evaluated the ability of an objective structured clinical examination (OSCE) administered in the first month of residency to predict future resident performance in the Accreditation Council for Graduate Medical Education (ACGME) core competencies.
Eighteen Postgraduate Year 1 (PGY-1) residents completed a five-station OSCE in the first month of postgraduate training. Performance was graded in each of the ACGME core competencies. At the end of 18 months of training, faculty evaluations of resident performance in the emergency department (ED) were used to calculate a cumulative clinical evaluation score for each core competency. The correlations between OSCE scores and clinical evaluation scores at 18 months were assessed on an overall level and in each core competency.
There was a statistically significant correlation between overall OSCE scores and overall clinical evaluation scores (R = 0.48, p < 0.05) and in the individual competencies of patient care (R = 0.49, p < 0.05), medical knowledge (R = 0.59, p < 0.05), and practice-based learning (R = 0.49, p < 0.05). No correlation was noted in the systems-based practice, interpersonal and communication skills, or professionalism competencies.
An early-residency OSCE has the ability to predict future postgraduate performance on a global level and in specific core competencies. Used appropriately, such information can be a valuable tool for program directors in monitoring residents' progress and providing more tailored guidance.

Download full-text


Available from: Sheryl Heron, Dec 17, 2014
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: This study explored the healthcare student's experience of an OSCE (Objective Structured Clinical Exam). The OSCE is a form of assessment in which the student demonstrates clinical skills, and underpinning knowledge, usually in simulated conditions. Historically, it has originated from medical education, and is now being adopted by other disciplines of healthcare education. Because the OSCE is a new experience for most students, it is important as educators, that we explore this assessment from the perspective of the student. A literature review revealed a paucity of research in this area. Hermeneutic phenomenology was used as this study's underpinning methodology. Data was collected through semi-structured interviews with students. Analysis revealed three main themes: (1) anxiety about the OSCE, (2) preparation was a seen as a coping strategy and (3) simulation was a further cause of anxiety. Recommendations for future practice: are that students need to be supported appropriately. Preparation of students for an OSCE requires effective planning and simulation needs to be grounded in practice. This study concludes that students valued the OSCE as a worthwhile assessment. However there are major concerns for students, which need careful consideration by academic faculty developing this type of assessment.
    01/2012; 1(1). DOI:10.7190/seej.v1i1.37
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The paper discusses various issues related to assessment in the context of the Arab world and focusing on 2 forms of assessment: multiple choice questions (MCQs) and objective structured clinical examinations (OSCEs). The appropriate assessment system is determined by the content and method of teaching as well as the expected knowledge and skills of the final product, the health professional. Assessment motivates students to study hard. It is also used to make decisions on promotion of students. A good assessment system cannot be imported; it must be home grown taking into consideration the cultural, linguistic, and educational background of the students. Centralized assessment not under the immediate control of teachers in contact with the students is appropriate for standardized examinations like the United States Medical Licensure Examination (USMLE) but is associated with many challenges in internal examinations within the teaching institution: complicated logistics, marginalization of the teachers, and the injustice of treating un-equals as equals. Assessment covers the two components of medicine: the science and the art (practical). The MCQ format assesses knowledge and its applications. The OSCE format assesses practical skills. Writing good MCQ items takes a lot of effort and time to review but is easy to administer and score. The OSCE based on simulated patients (SP) has ably replaced the traditional long and short clinical cases but penalizes the advanced candidate who asks the SP questions off the script. I propose using SPs who actually had personal experience of the condition being tested. I also propose some items in the OSCE that are of critical knowledge for professionals and which should have higher scores assigned to them. Students should be failed in the whole examination if they do not know some of these critical items.
    08/2013; 8(2):72–79. DOI:10.1016/j.jtumed.2013.07.001
  • [Show abstract] [Hide abstract]
    ABSTRACT: Objectively structured clinical examinations (OSCEs) are widely used in medical education, but we know of none described that are specifically for nephrology fellowship training. OSCEs use simulation to educate and evaluate. We describe a technically simple, multidisciplinary, low-cost OSCE developed by our program that contains both examination and training features and focuses on management and clinical knowledge of rare hemodialysis emergencies. The emergencies tested are venous air embolism, blood leak, dialysis membrane reaction, and hemolysis. Fifteen fellows have participated in the OSCE as examinees and/or preceptors since June 2010. All have passed the exercise. Thirteen responded to an anonymous survey in July 2013 that inquired about their confidence in managing each of the 4 tested emergencies pre- and post-OSCE. Fellows were significantly more confident in their ability to respond to the emergencies after the OSCE. Those who subsequently saw such an emergency reported that the OSCE experience was somewhat or very helpful in managing the event. The OSCE tested and trained fellows in the recognition and management of rare hemodialysis emergencies. OSCEs and simulation generally deserve greater use in nephrology subspecialty training; however, collaboration between training programs would be necessary to validate such exercises.
    American Journal of Kidney Diseases 06/2014; 63(6). DOI:10.1053/j.ajkd.2014.01.419 · 5.76 Impact Factor