The use of standardized patients to evaluate family medicine resident decision making

Wilson Family Practice Residency, Johnson City, NY 13790, USA.
Family medicine (Impact Factor: 1.17). 04/2007; 39(4):261-5.
Source: PubMed


This study was intended to assess the usefulness of standardized patients (SPs) in the evaluation of family medicine residents' clinical decision-making skills in ambulatory settings.
A pool of SPs was trained about the symptoms of one of three clinical conditions (depression, headache, or irritable bowel syndrome). These patients were then surreptitiously incorporated into the office hours of 11 residents on one occasion during their second year and once during their third year of training. A different SP was used at each encounter, but the same clinical case was presented each year for that particular resident. The SPs were given a questionnaire after each office visit to evaluate whether the resident completed elements of history, physical exam, clinical decision making specific to their case, and to report their satisfaction with the encounter. In addition, the assessment component of the resident's progress notes for each SP visit was reviewed by a single examiner to determine if the correct diagnosis was made by the resident.
The residents showed a statistically significant decrease in the percentage of checklist items completed for all clinical cases from the second year (82.70%) to the third year (75.55%). However, the average patient satisfaction was unchanged, as was the number of correct diagnoses, even though fewer questions were asked.
The use of SPs is a feasible and potentially useful method for evaluating family medicine resident decision making. Several factors may account for the differences in resident performance with SP scenarios.

Download full-text


Available from: Gary D James
  • [Show abstract] [Hide abstract]
    ABSTRACT: Effective communication skills for clinical practice are essential for all advanced practice nurses. However, competence in these skills is not necessarily intuitive. Advanced communication skills should be taught in a way that is similar to the way other psychomotor skills in advanced nursing practice programs are taught. To develop a patient communication simulation laboratory for the acute care nurse practitioner program at a major university and to evaluate students' perceived confidence and communication effectiveness before and immediately as well as 4 months after completion of the laboratory. The communication simulation laboratory was developed in collaboration with faculty from the schools of nursing and medicine. Students participated in a didactic session and then completed a 2-hour communication simulation in the laboratory. Content and simulation concentrated on breaking "bad news," empathetic communication, motivational interviewing, and the "angry" patient. Students' self-reported confidence and perceived skill in communication were measured via a Likert scale before, immediately after, and 4 months after completion of the laboratory simulation. Students also evaluated the experience by responding to open-ended questions. Compared with baseline findings (before the lecture and simulation), students' confidence in initiating difficult conversations increased significantly both immediately (P<.001) and 4 months after (P=.001) the laboratory simulation. Students' self-ratings of overall ability to communicate were also significantly greater immediately (P<.001) and 4 months (P=.001) after the simulation. Overall, students rated the laboratory simulation experience highly beneficial. The content and methods used for the simulation improved students' confidence and perceived skill in communication in potentially difficult acute care situations.
    No preview · Article · Aug 2008 · American Journal of Critical Care
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Effective communication skills and professionalism are critical for physicians in order to provide optimum care and achieve better health outcomes. The aims of this study were to evaluate residents' self-assessment of their communication skills and professionalism in dealing with patients, and to evaluate the psychometric properties of a self-assessment questionnaire. A modified version of the American Board of Internal Medicine's (ABIM) Patient Assessment survey was completed by 130 residents in 23 surgical and non-surgical training programs affiliated with a single medical school. Descriptive, regression and factor analyses were performed. Internal consistency, inter-item gamma scores, and discriminative validity of the questionnaire were determined. Factor analysis suggested two groups of items: one group relating to developing interpersonal relationships with patients and one group relating to conveying medical information to patients. Cronbach's alpha (0.86) indicated internal consistency. Males rated themselves higher than females in items related to explaining things to patients. When compared to graduates of U.S. medical schools, graduates of medical schools outside the U.S. rated themselves higher in items related to listening to the patient, yet lower in using understandable language. Surgical residents rated themselves higher than non-surgical residents in explaining options to patients. This appears to be an internally consistent and reliable tool for residents' self-assessment of communication skills and professionalism. Some demographic differences in self-perceived communication skills were noted.
    Full-text · Article · Feb 2009 · BMC Medical Education
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Increasing numbers of medical schools are providing videos of lectures to their students. This study sought to analyze utilization of lecture videos by medical students in their basic science courses and to determine if student utilization was associated with performance on exams. Streaming videos of lectures (n = 149) to first year and second year medical students (n = 284) were made available through a password-protected server. Server logs were analyzed over a 10-week period for both classes. For each lecture, the logs recorded time and location from which students accessed the file. A survey was administered at the end of the courses to obtain additional information about student use of the videos. There was a wide disparity in the level of use of lecture videos by medical students with the majority of students accessing the lecture videos sparingly (60% of the students viewed less than 10% of the available videos. The anonymous student survey revealed that students tended to view the videos by themselves from home during weekends and prior to exams. Students who accessed lecture videos more frequently had significantly (p < 0.002) lower exam scores. We conclude that videos of lectures are used by relatively few medical students and that individual use of videos is associated with the degree to which students are having difficulty with the subject matter.
    Full-text · Article · Feb 2009 · BMC Medical Education
Show more