How to develop a competency-based examination blueprint for longitudinal standardized patient clinical skills assessments

University of Washington School of Medicine , USA.
Medical Teacher (Impact Factor: 1.68). 07/2013; 35(11). DOI: 10.3109/0142159X.2013.809408
Source: PubMed


Background: Objective Structured Clinical Exams (OSCEs) with standardized patients (SPs) are commonly used in medical education to assess learners' clinical skills. However, assessments are often discrete rather than intentionally developmentally sequenced. Aims: We developed an examination blueprint to optimize assessment and feedback to learners with purposeful sequence as a series of longitudinally integrated assessments based on performance milestones. Integrated and progressive clinical skills assessments offer several benefits: assessment of skill development over time, systematic identification of learning needs, data for individualized feedback and learning plans, and baseline reference points for reassessment. Methods: Using a competency-based medical education (CBME) framework, we translated pre-determined competency milestones for medical students' patient encounters into a four-year SP-based OSCE examination blueprint. Results: Initial evaluation of cases using the blueprint revealed opportunities to target less frequently assessed competencies and to align assessments with milestones for each year. Conclusions: The examination blueprint can guide ongoing SP-based OSCE case design. Future iterations of examination blueprints can incorporate lessons learnt from evaluation data and student feedback.

102 Reads
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Shoklo Malaria Research Unit has been providing health care in remote clinics on the Thai-Myanmar border to refugee and migrant populations since 1986 and 1995, respectively. Clinics are staffed by local health workers with a variety of training and experience. The need for a tool to improve the competence of local health workers in basic emergency assessment and management was recognised by medical faculty after observing the case mix seen at the clinic and reviewing the teaching programme that had been delivered in the past year (Jan-13 to March-14). To pilot the development and evaluation of a simple teaching tool to improve competence in the assessment and management of acutely unwell patients by local health workers that can be delivered onsite with minimal resources. A structured approach to common emergencies presenting to rural clinics and utilizing equipment available in the clinics was developed. A prospective repeated-measures observed structured clinical examination (OSCE) assessment design was used to score participants in their competence to assess and manage a scenario based 'emergency patient' at baseline, immediately post-course, and 8 weeks after the delivery of the teaching course. The assessment was conducted at 3 clinic sites and staff participation was voluntary. Participants filled out questionnaires on their confidence with different scenario based emergency patients. All staff who underwent the baseline assessment failed to carry out the essential steps in initial emergency assessment and management of an unconscious patient scenario. Following delivery of the teaching session, all groups showed improved competence in both objective assessment and subjective confidence levels. Structured and practical teaching and learning with minimal theory in this resource limited setting had a positive short-term effect on the competence of individual staff to carry out an initial assessment and manage an acutely unwell patient. Health-worker confidence likewise improved. Workplace assessments are needed to determine if this type of skills training impacts upon mortality or near miss mortality patients at the clinic.
    Conflict and Health 12/2015; 9(1):11. DOI:10.1186/s13031-015-0041-x
  • Source
    [Show description] [Hide description]
    DESCRIPTION: Structured and practical teaching and learning with minimal theory in this resource limited setting had a positive short-term effect on the competence of individual staff to carry out an initial assessment and manage an acutely unwell patient.
  • [Show abstract] [Hide abstract]
    ABSTRACT: Context: Basic medical sciences and clinical teachings are not coordinated in the present medical education system. They are not taught keeping in mind the outcomes required at the time of actual handling of patients in the community. Aims: An educational development project was implemented in the Department of Pathology with the aim that it will result in the student learning to link the pathophysiology of the disease to clinical scenarios and become fully competent for lifelong medical practice. Subjects and Methods: The pathology teaching of the second professional batch was modified by starting with defining the desired outcomes/competencies in the student's knowledge, skills, and attitude which were then addressed by lectures, demonstrations, practical classes and small group activities where case scenarios and laboratory reports were included. The outcome was assessed by Objectively Structured Clinical/Practical Examination and multiple choice questions. Force field analysis, faculty and student interviews, and questionnaires were used to assess the factors affecting its implementation and impact. Results: Totally 80 students of the 2nd Professional MBBS were exposed to a competency-based education development project. It was found that the system was appreciated by faculty and students, especially the integration with clinical scenarios. There were many factors which influenced the execution of this program, including motivation level of students and faculty, time, logistics and meticulous planning. Conclusions: There was a significant improvement in student's performance and satisfaction. Many factors including prior planning were a major determinant for the success of this education development project.
    08/2015; 5(4):7. DOI:10.4103/2229-516X.162254