Robert L Williams’s research while affiliated with University of New Mexico and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (38)


A Comparative Case Study Analysis of Cultural Competence Training at 15 U.S. Medical Schools
  • Article

February 2021

·

80 Reads

·

16 Citations

Academic Medicine

Cirila Estela Vasquez Guzman

·

·

·

[...]

·

Robert L Williams

Purpose: Twenty years have passed since the Liaison Committee on Medical Education (LCME) mandated cultural competence training in U.S. medical schools. There remain multiple challenges to implementation of this training, including curricular constraints, varying interpretations of cultural competence, and evidence supporting the efficacy of such training. This study explored how medical schools have worked to implement cultural competence training. Method: Fifteen regionally diverse public and private U.S. medical schools participated in the study. In 2012-2014 the authors conducted 125 interviews with 52 administrators, 51 faculty or staff members, and 22 third- and fourth-year medical students, along with 29 focus groups with an additional 196 medical students. Interviews were recorded, transcribed, and imported into NVivo 10 software for qualitative data analysis. Queries captured topics related to students' preparedness to work with diverse patients, engagement with socio-cultural issues, and general perception of preclinical and clinical curricula. Results: Three thematic areas emerged regarding cultural competence training: formal curriculum, conditions of teaching, and institutional commitment. At the formal curricular level, schools offered a range of courses collectively emphasizing communication skills, patient-centered care, and community-based projects. Conditions of teaching emphasized integration of cultural competence into the preclinical years and reflection on the delivery of content. At the institutional level, commitment to institutional diversity, development of programs, and degree of prioritization of cultural competence varied. Conclusions: There is variation in how medical schools approach cultural competence. Among the 15 participating schools, longitudinal and experiential learning emerged as important, highlighting the needs beyond mere integration of cultural competence content into the formal curriculum. To determine efficacy of cultural competence programming, it is critical to conduct systematic assessment to identify and address gaps. While LCME standards have transformed aspects of medical education, further research is needed to clarify evidence-based, effective approaches to this training.


Racial/Gender Biases in Student Clinical Decision-Making: a Mixed-Method Study of Medical School Attributes Associated with Lower Incidence of Biases

July 2018

·

44 Reads

·

20 Citations

Journal of General Internal Medicine

Background: Accumulating evidence suggests that clinician racial/gender decision-making biases in some instances contribute to health disparities. Previous work has produced evidence of such biases in medical students. Objective: To identify contextual attributes in medical schools associated on average with low levels of racial/gender clinical decision-making biases. Design: A mixed-method design using comparison case studies of 15 medical schools selected based on results of a previous survey of student decision-making bias: 7 schools whose students collectively had, and 8 schools whose students had not shown evidence of such biases. Participants: Purposively sampled faculty, staff, underrepresented minority medical students, and clinical-level medical students at each school. Main measures: Quantitative descriptive data and qualitative interview and focus group data assessing 32 school attributes theorized in the literature to be associated with formation of decision-making and biases. We used a mixed-method analytic design with standard qualitative analysis and fuzzy set qualitative comparative analysis. Key results: Across the 15 schools, a total of 104 faculty, administrators and staff and 21 students participated in individual interviews, and 196 students participated in 29 focus groups. While no single attribute or group of attributes distinguished the two clusters of schools, analysis showed some contextual attributes were seen more commonly in schools whose students had not demonstrated biases: longitudinal reflective small group sessions; non-accusatory approach to training in diversity; longitudinal, integrated diversity curriculum; admissions priorities and action steps toward a diverse student body; and school service orientation to the community. Conclusions: We identified several potentially modifiable elements of the training environment that are more common in schools whose students do not show evidence of racial and gender biases.


Moving Away from the Tip of the Pyramid: Screening and Brief Intervention for Risky Alcohol and Opioid Use in Underserved Patients

March 2018

·

28 Reads

·

13 Citations

The Journal of the American Board of Family Medicine

Purpose: Rates of risky substance use and substance use disorders are high in primary-care practices, yet the adoption of universal screening and brief intervention (SBI) has been slow and uneven. This study aimed to describe SBI-related attitudes, practices, and perspectives regarding practice change among medical providers in a minority-majority state. Methods: We conducted a cross-sectional, on-line survey of a practice-based research network of medical providers serving predominantly Hispanic/Latinx and Native American patients in rural and urban settings. The main variables were clinician 1) perspectives on the need to address substance use problems in primary care, 2) current screening and intervention practices, and 3) satisfaction with and willingness to make changes to their practices. Results: Although providers endorsed alcohol and opiate misuse to be significant problems in their practices, only 25% conducted universal screening. Providers reported focusing most of their screening efforts on those with substance use dependence. In general, providers rated importance of and ability to make practice changes moderately high. There was high interest in practice coordination with the community followed by interest in a collaborative care approach. Conclusions: Providers mainly focus efforts on the relatively few patients at the tip of the pyramid (substance use dependence) rather than on the majority of patients who comprise the middle of the pyramid (risky substance use). Practice change strategies are needed to increase universal screening with a focus on risky substance use, particularly in practices serving racial/ethnic communities.


Costs and inconsistencies in US IRB review of low-risk medical education research

June 2015

·

59 Reads

·

8 Citations

Medical Education

ContextAdvances in communication technologies over the last two decades have transformed the way medical education research is conducted, creating opportunities for multi-institution national and international studies. Although these studies enable researchers to gain broader understandings of educational processes across institutions, they increase the need for multiple institutional review board (IRB) reviews to ensure the protection of human subjects.Objectives This study describes the process of obtaining multiple IRB approvals of the same protocol for a multi-site, low-risk, medical education research project in the USA. The burden of obtaining those reviews and their consistency are assessed. The associated time and costs, and implications for the research process are detailed.Methods Following review by the investigators' parent institution IRB, the project team circulated a uniform protocol for conduct of a low-risk, medical education survey to the IRBs of 89 US medical schools for review. The processes and time required to obtain approvals were recorded to estimate associated research team personnel costs.ResultsApproval could not be obtained from five IRBs as a result of insurmountable procedural barriers. A total of 67 IRBs eventually deferred to the parent IRB determination. The remaining IRBs required a variety of additional procedural processes before ultimately agreeing with the original determination. The personnel costs associated with obtaining the 84 approvals amounted to US$121 344.Conclusions Considering the value of multi-site designs to address a range of research questions, enhance participant diversity and develop representative findings, solutions must be found to counter inefficiencies of current IRB review processes for low-risk research, such as that usually conducted in medical education. Although we acknowledge that local review is an essential protective measure for research involving identifiable communities that are uniquely susceptible to social or economic harm, this report suggests that proposals to modernise and streamline IRB review processes for low-risk research are timely and relevant.


Table 1 Comparison of Survey Participants to Association of American Medical Colleges (AAMC) Senior Medical Student Survey Participants, 2012 * 
Table 2 Comparison of Senior Medical Student Recommendations for Cardiac Vignette Patients Based on Vignette Patient Gender and Race, 2012 
Table 5 Results of Multilevel Multivariable Analysis of Student Recommendations for Cardiac Vignette Patients 
Racial, Gender, and Socioeconomic Status Bias in Senior Medical Student Clinical Decision-Making: A National Survey
  • Article
  • Full-text available

January 2015

·

215 Reads

·

30 Citations

Journal of General Internal Medicine

Background: Research suggests stereotyping by clinicians as one contributor to racial and gender-based health disparities. It is necessary to understand the origins of such biases before interventions can be developed to eliminate them. As a first step toward this understanding, we tested for the presence of bias in senior medical students. Objective: The purpose of the study was to determine whether bias based on race, gender, or socioeconomic status influenced clinical decision-making among medical students. Design: We surveyed seniors at 84 medical schools, who were required to choose between two clinically equivalent management options for a set of cardiac patient vignettes. We examined variations in student recommendations based on patient race, gender, and socioeconomic status. Participants: The study included senior medical students. Main measures: We investigated the percentage of students selecting cardiac procedural options for vignette patients, analyzed by patient race, gender, and socioeconomic status. Key results: Among 4,603 returned surveys, we found no evidence in the overall sample supporting racial or gender bias in student clinical decision-making. Students were slightly more likely to recommend cardiac procedural options for black (43.9 %) vs. white (42 %, p = .03) patients; there was no difference by patient gender. Patient socioeconomic status was the strongest predictor of student recommendations, with patients described as having the highest socioeconomic status most likely to receive procedural care recommendations (50.3 % vs. 43.2 % for those in the lowest socioeconomic status group, p < .001). Analysis by subgroup, however, showed significant regional geographic variation in the influence of patient race and gender on decision-making. Multilevel analysis showed that white female patients were least likely to receive procedural recommendations. Conclusions: In the sample as a whole, we found no evidence of racial or gender bias in student clinical decision-making. However, we did find evidence of bias with regard to the influence of patient socioeconomic status, geographic variations, and the influence of interactions between patient race and gender on student recommendations.

Download

Figure 1: Flow Chart of Participation in Senior Medical Student Survey 
Table 2 : Comparison of Senior Medical Student Survey Respondents to Students Responding to AAMC Graduating Senior Survey
Student Specialty Plans, Clinical Decision Making, and Health Care Reform

May 2014

·

373 Reads

·

2 Citations

Family Medicine

Background and objectives: Health care reform aims to increase evidence-based, cost-conscious, and patient-centered care. Family medicine is seen as central to these aims in part due to evidence of lower cost and comparable quality care compared with other specialties. We sought evidence that senior medical students planning family medicine residency differ from peers entering other fields in decision-making patterns relevant to these health care reform aims. Methods: We conducted a national, anonymous, internet-based survey of senior medical students. Students chose one of two equivalent management options for a set of patient vignettes based on preventive care, medication selection, or initial chronic disease management scenarios, representing in turn evidence-based care, cost-conscious care, and patient-centered care. We examined differences in student recommendations, comparing those planning to enter family medicine with all others using bivariate and weighted, multilevel, multivariable analyses. Results: Among 4,656 surveys received from seniors at 84 participating medical schools, students entering family medicine were significantly more likely to recommend patient management options that were more cost conscious and more patient centered. We did not find a significant difference between the student groups in recommendations for evidence-based care vignettes. Conclusions: This study provides preliminary evidence suggesting that students planning to enter family medicine may already have clinical decision-making patterns that support health care reform goals to a greater extent than their peers. If confirmed by additional studies, this could have implications for medical school admission and training processes.


Table 3 . Recommended Strategies for Recruiting and Retaining Diverse Communities in Research 
Cultivating a Cycle of Trust With Diverse Communities in Practice-Based Research: A Report From PRIME Net

November 2013

·

137 Reads

·

37 Citations

The Annals of Family Medicine

Purpose: Practice-based research networks (PBRNs) are increasingly seen as important vehicles to translate research into practice, although less is known about the process of engaging diverse communities in PBRN research. The objective of this study was to identify strategies for successfully recruiting and retaining diverse racial/ethnic communities into PBRN research studies. Methods: This collaborative, multisite study engaged 5 of the 8 networks of the PRImary care MultiEthnic Network (PRIME Net) consortium that conducts research with traditionally underrepresented/underserved populations. We used a sequential, qualitative research design. We first conducted 1 key informant interview with each of 24 researchers experienced in recruiting research participants from 5 racial/ethnic communities (African American, Arab/Chaldean, Chinese, Hispanic, and Native American). Subsequently, we conducted 18 focus groups with 172 persons from these communities. Results: Participants' comments indicated that successful recruitment and retention of underrepresented populations in PBRN studies is linked to the overall research process. This process, which we termed the cycle of trust, entailed developing and sustaining relationships of trust during 4 interrelated stages: before the study, during study recruitment, throughout study conduct, and after study completion. Participants identified a set of flexible strategies within each stage and called for close engagement with clinic and community partners. Conclusions: Our participants suggest that approaches to research that lay a foundation of trust, demonstrate respect for community members, and extend beyond the enrollment and data collection phases are essential to enhance the participation of diverse populations in PBRN research. These findings offer the PBRN community a guide toward achieving this important goal.


Primary Care Providers' Needs and Preferences for Information about Colorectal Cancer Survivorship Care

September 2012

·

45 Reads

·

43 Citations

The Journal of the American Board of Family Medicine

The Institute of Medicine (IOM) proposed that cancer survivors and their primary care providers (PCPs) should receive survivorship care plans to inform ongoing care. We aimed to determine PCPs' preferences for the content of survivorship care plans for colorectal cancer (CRC) survivors. PCPs in 3 practice-based research networks completed a survey regarding 45 topics of CRC information based on the IOM's survivorship care plan framework. One hundred fifty-six PCPs completed the survey. For 35 topics (78%), at least half of respondents felt the topic was very important. Most PCPs reported receiving too little information about problems with chemotherapy (68%) or radiation (60%) and whether the oncologist intended to monitor for other cancers (71%). PCPs widely agreed that they do not have enough information about increased risk of second CRCs, other cancers, and other diseases (78%); long-term effects of chemotherapy (73%) and radiation (67%); and genetic counseling (83%). PCPs endorse the IOM's survivorship care plan framework as relevant and often report needing more information. Survivorship care plans may provide important information to PCPs by communicating patients' cancer histories and making recommendations regarding which aspects of care should be provided by the oncologist or the PCP.


Reports of Persistent Change in the Clinical Encounter Following Research Participation: A Report From the Primary Care Multiethnic Network (PRIME Net)

September 2011

·

51 Reads

·

20 Citations

The Journal of the American Board of Family Medicine

Following anecdotal reports of unexpected patient and/or clinician behavior change in the primary care encounter in a previous study, we conducted this study to learn more about the short- and long-term effects on clinician and/or patient behavior from participation in a practice-based research network (PBRN) study. Clinicians in two PBRN studies of Acanthosis nigricans were surveyed and interviewed 3 to 6 months following one study and surveyed 3 to 5 years following a second study. We gathered data on clinicians' reports of behavior change in the encounter, the persistence of those changes, and the likely causes of reported changes. Eighty-six percent of clinicians in the short-term and 79% in the long-term samples reported more frequent diagnostic efforts, and 68% and 54%, respectively, reported more frequent preventive counseling after participation in the studies. Interview data suggested that several factors contributed to this reported behavior change: increased clinician knowledge, availability of a feasible tool to support counseling, change in patient receptivity/motivation, and creation of a new context for counseling. Reports of behavior change in the primary care encounter associated with a PBRN study suggest that PBRNs may be effective vehicles for education, translation, and practice change in addition to their value in research.


Figure 1. Effects of Office Score on perceived opioid efficacy and burden for opioid prescribing clinicians. Clinicians were assigned one point for use of each of five office systems: Pain Assessment Tool, Controlled Substance Agreement (Narcotic Contract), Refill Policy, Prescription log, and Urine Drug Screening. 
Chronic non-cancer pain: A siren for primary care - A report from the Primary Care MultiEthnic Network (PRIME Net)

September 2011

·

92 Reads

·

57 Citations

The Journal of the American Board of Family Medicine

Patients with chronic non-cancer pain (CNCP) are common and have a high degree of morbidity. Previous studies document clinician frustration and variability in CNCP management. We conducted this study to gather in-depth clinicians' views about factors that affect management of CNCP. We conducted a survey in the Primary Care MultiEthnic Network, a consortium of PBRNs of primary care clinicians practicing in low-income, medically underserved communities, and in a network of private primary care offices. Of 792 clinicians surveyed, 497 (63%) participated. Responses and accompanying narrative comments clustered around 5 themes: (1) barriers to and uncertainties in optimal management; (2) the complex biopsychosocial nature of CNCP; (3) seriousness of prescription opioid abuse; (4) effort and burden required to properly manage CNCP; and (5) clinician commitment to provide care for CNCP patients and benefits of expanded care model for CNCP. One-third reported a severe outcome (death or life-threatening event) in a CNCP patient for whom they had prescribed opioids. Roughly one-third do not initiate prescribing of opioids. Guidelines and increased continuing medical education alone are unlikely to be the solutions to the challenges of CNCP management. Increased evidence for recommendations and resources for more comprehensive care management are needed.


Citations (35)


... However, discipline primarily refers to enforcing rules and corrective actions, whereas classroom management extends to proactive measures that promote a positive learning experience. Studies indicate that male and female students exhibit distinct behavioral tendencies; boys are often more prone to overt disruptions such as talking out of turn and restlessness, whereas girls tend to engage in subtle distractions like off-topic conversations or reduced attentiveness (3). Given these behavioral variations, teachers in coeducational classrooms may need to adopt gender-sensitive strategies to maintain order while ensuring an inclusive educational experience (4). ...

Reference:

EXPLORING THE INFLUENCE OF GENDER ON CLASSROOM MANAGEMENT STRATEGIES IN CO-EDUCATION SCHOOLS: A COMPARATIVE ANALYSIS OF MALE AND FEMALE TEACHERS
A Comparative Case Study Analysis of Cultural Competence Training at 15 U.S. Medical Schools
  • Citing Article
  • February 2021

Academic Medicine

... These perspectives can inform medical education leaders in their development of anti-bias training [26][27][28] and other teacher development activities to equip residents and faculty to notice and intervene when they see gender bias in their students' patient care experience. Future studies should continue to examine how to influence the culture of medical institutions and the medical education experience of learners [30]. ...

Racial/Gender Biases in Student Clinical Decision-Making: a Mixed-Method Study of Medical School Attributes Associated with Lower Incidence of Biases
  • Citing Article
  • July 2018

Journal of General Internal Medicine

... Screening adult primary care patients for unhealthy alcohol use has been recommended by the United States Preventive Services Task Force (USPSTF) since 1996 [12], and drug screening since 2020 [13]. Although screening for substance use in medical settings could be an important step toward reducing the negative health impacts of alcohol and drugs, it is infrequently done [14][15][16][17][18]. ...

Moving Away from the Tip of the Pyramid: Screening and Brief Intervention for Risky Alcohol and Opioid Use in Underserved Patients
  • Citing Article
  • March 2018

The Journal of the American Board of Family Medicine

... Generally, looking into the procedures for submission of protocols to the secretariat of the IRBs showed that these were more or less the same across IRB institutions in Tanzania and beyond (Ikingura, Kruger et al. 2007;Getz, Zuckerman et al. 2011). Delays and obstacles to the commencement of research projects associated with IRB procedures and their lack of consistency and efficiency have also been reported elsewhere (Hyman 2007;Klitzman 2008;Silberman and Kahn 2011;Klitzman 2012;Lidz, Appelbaum et al. 2012;Lidz and Garverich 2013;Kano, Getrich et al. 2015;Caligiuri, Allen et al. 2017;Nxumalo 2017;Nyeboer and Page 2017). ...

Costs and inconsistencies in US IRB review of low-risk medical education research
  • Citing Article
  • June 2015

Medical Education

... For instance, some studies have revealed implicit anti-Black attitudes persisting among US medical students [4,7]. Others have found that patients' socioeconomic status (SES) impacts medical students' biases [3,8]. Additionally, studies have rarely focused on the biases of students from racial minority groups and findings might be prejudiced. ...

Racial, Gender, and Socioeconomic Status Bias in Senior Medical Student Clinical Decision-Making: A National Survey

Journal of General Internal Medicine

... These factors include the authenticity of clinical experience, students' perceptions of primary care settings, and the quality of care provided. While authentic clinical experiences and distinctions between primary care and hospital settings facilitate clinical reasoning learning, challenges include the translation of reasoning between settings and variations in the standard of care [9,11,12,[16][17][18]27,29,30,[34][35][36][37][38]. ...

Student Specialty Plans, Clinical Decision Making, and Health Care Reform

Family Medicine

... The CRs contributed to the full process, bringing expertise from their lived experience with pregnancy and parenting in the Black and Pacific Islander communities: developing research questions, formulating survey and interview instruments, recruiting participants, conducting interviews, facilitating design sprints, interpreting results, and making key program decisions. CRs received training in data collection and analysis supported by the university-based staff, which coupled with the team's shared power structure, helped to dismantle the hierarchy often present in research institutions that keeps community members out of decision-making processes [41,42]. Expecting Justice also led an ABP working group with birth equity stakeholders, including Black and Pacific Islander mothers, community organization representatives, social service providers, maternal health leaders and researchers, and representatives from health plans to collaborate and provide strategic resources to support program development. ...

Cultivating a Cycle of Trust With Diverse Communities in Practice-Based Research: A Report From PRIME Net

The Annals of Family Medicine

... Common affected areas include the intertriginous areas of the body; however, AN may also be found on the scalp, joints, nipples, and palmar areas [9]. In a cross-sectional study, AN was found in 19.4% of patients; those with AN were found to be twice as likely to have T2DM than patients without this dermatological condition [10]. AN is also linked with obesity, hormone disorders, and internal malignancy [7,8]. ...

Acanthosis Nigricans: High Prevalence and Association with Diabetes in a Practice-based Research Network Consortium--A PRImary care MultiEthnic Network (PRIME Net) Study

The Journal of the American Board of Family Medicine

... Thirty-seven articles (38%) determined that access to cancerspecific resources is a significant barrier faced by PCPs in the provision of survivorship care [7, 12, 17-19, 21, 33, 36, 44-46, 48, 49, 51, 59, 60, 63, 65, 68-71, 73, 74, 77, 79-84, 86, 89, 96, 102, 103, 107]. Of these 37 articles, 20 (54%) discussed that a lack of well-defined survivorship guidelines is a major factor undermining a PCPs' capability to care for cancer survivors [7,12,17,19,33,36,44,45,48,49,51,60,63,65,69,70,84,89,96,103], and were published almost exclusively in the past 10 years. In addition, two articles mentioned geographical factors as a barrier to PCP-led survivorship care, with cancer survivors in rural areas having to rely on their PCP for additional aspects of cancer care that would typically be managed by a cancer specialist in an urban setting [48,108]. ...

Primary Care Providers' Needs and Preferences for Information about Colorectal Cancer Survivorship Care
  • Citing Article
  • September 2012

The Journal of the American Board of Family Medicine

... Kristina, Majoor and Van Der Vleuten suggest that there is a greater benefit for students than for communities, 11 but Williams, Reid, Myeni suggest that although communities do not benefit from CBE in the same way as students do, there is potential for a more balanced partnership where the community is consulted in planning a health programme that is relevant to that community's particular needs. 12 Benefits to the community include both immediate and long term benefits. These range from increased access to service as a result of student placement in the typically overburdened community sites, 8 improved patient care because of the quality of service offered as a result of updated practice techniques 1,5,8 and clinic staff being able to interact with the university. ...

Practical skills and valued community outcomes: the next step in community‐based education

Medical Education