Article

The Objective Structured Clinical Examination. The New Gold Standard for Evaluating Postgraduate Clinical Performance

Department of Surgery, University of Kentucky Chandler Medical Center, Lexington, USA.
Annals of Surgery (Impact Factor: 8.33). 01/1996; 222(6):735-42. DOI: 10.1097/00000658-199512000-00007
Source: PubMed

ABSTRACT

The authors determine the reliability, validity, and usefulness of the Objective Structured Clinical Examination (OSCE) in the evaluation of surgical residents.
Interest is increasing in using the OSCE as a measurement of clinical competence and as a certification tool. However, concerns exist about the reliability, feasibility, and cost of the OSCE. Experience with the OSCE in postgraduate training programs is limited.
A comprehensive 38-station OSCE was administered to 56 surgical residents. Residents were grouped into three levels of training; interns, junior residents, and senior residents. The reliability of the examination was assessed by coefficient alpha; its validity, by the construct of experience. Differences between training levels and in performance on the various OSCE problems were determined by a three-way analysis of variance with two repeated measures and the Student-Newman-Keuls post hoc test. Pearson correlations were used to determine the relationship between OSCE and American Board of Surgery In-Training Examination (ABSITE) scores.
The reliability of the OSCE was very high (0.91). Performance varied significantly according to level of training (postgraduate year; p < 0.0001). Senior residents performed best, and interns performed worst. The OSCE problems differed significantly in difficulty (p , 0.0001). Overall scores were poor. Important and specific performance deficits were identified at all levels of training. The ABSITE clinical scores, unlike the basic science scores, correlated modestly with the OSCE scores when level of training was held constant.
The OSCE is a highly reliable and valid clinical examination that provides unique information about the performance of individual residents and the quality of postgraduate training programs.

Download full-text

Full-text

Available from: William E. Strodel, Jun 13, 2014
  • Source
    • "Objective structured clinical examination (OSCE) has become a mainstay of assessment in medical and healthcare education reflecting a competency-based paradigm[1]. A useful tool, OSCE has been described as the 'gold standard' for assessment of clinical competence[2,3]. Many of the benefits of OSCEs are related to their feasibility, flexibility and adaptability. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Objective Structured Clinical Examination (OSCE) is a core component of undergraduate medical student assessment. With increased emphasis on integrated programmes, more courses include OSCEs in the traditionally ‘preclinical’ years. The acceptability and impact of such assessment methods at this stage of training is unknown. In 2013 and 2014 University College London Medical School piloted a formative, integrated OSCE in years 1 and 2 of the undergraduate medical degree programme. This study with a sequential exploratory design aimed to explore the acceptability and impact of such an OSCE in the early years of medical school. 1280 students completed the OSCE and were invited to complete a questionnaire exploring their views of the OSCE (response rate 96.6 %). Four focus groups, each with five or six participants (22 in total) were subsequently held to further explore themes. Data was independently transcribed and coded using thematic analysis. Students were strongly in favour of the introduction of an OSCE in addition to existing assessments. Six overarching themes were identified: application of knowledge and skills; OSCE as an experience; OSCE as a process; a learning curve; becoming a doctor; and creating an effective OSCE. Results strongly support the role of OSCE early in the medical course with many benefits reported. An OSCE at this stage aligns with the vision of integrated medical education which includes early patient contact and introduction of clinical and professional skills. It also fosters feelings of responsibility and professional identity amongst students.
    Full-text · Article · Jan 2016 · BMC Medical Education
  • Source
    • "(Barman, 2005; Caraccio, 2000; Merrick, 2000; Auewarakul, 2005). Its reliability is determined mainly by the number of stations, with more stations increasing the reliability (Barman, 2005; Sloan 1995; Joorabchi, 1991). "

    Preview · Article · Jan 2012
  • Source
    • "Because SPAs are simulated doctor– patient consultations in which an actor is trained to play the role of a patient in a standardized way, they are useful in evaluating interpersonal communication skills in a specific domain. Using interitem and split-half reliability methods, the SPA has proved to be a reliable assessment tool and has demonstrated discriminant validity (Sloan et al., 1995). Using SPAs will enable us to observe each participant demonstrate communication skills in a specific situation of a predetermined and standardized duration. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The purpose of this study was to develop a communication skills training (CST) module for oncology healthcare professionals on how to more effectively respond to patient anger. We also sought to evaluate the module in terms of participant self-efficacy and satisfaction. The development of this module was based on a systematic review of the literature and followed the Comskil model previously used for other doctor-patient CST. Using an anonymous 5-point Likert scale, participants rated their pre-post self-efficacy in responding to patient anger as well as their satisfaction with the course. Data were analyzed using a paired sample t test. During the academic years 2006-2009, 275 oncology healthcare professionals participated in a CST that focused on responding to patient anger. Participants' confidence in responding to patient anger increased significantly (p < 0.001) after attending the workshop. They also agreed or strongly agreed to five out of six items assessing course satisfaction 92-97% of the time. We have developed a CST module on how to respond to patient anger, which is both effective and useful. Training healthcare professionals to respond more effectively to patient anger may have a positive impact on the patient-physician relationship.
    Full-text · Article · Dec 2011 · Palliative and Supportive Care
Show more