Elissa Hall’s research while affiliated with Mayo Clinic - Rochester and other places

Online learning has assumed a mainstream role in health professions education. Everyone seems to be doing it—but are they doing it well? What are the unique affordances, requirements, and best practices that should be considered when planning and implementing faculty development using internet-based technologies? After reviewing available evidence, this chapter will present advantages and disadvantages of online faculty development, summarize evidence-based principles of instructional design for online learning, highlight emerging best practices for online delivery modalities, and provide several examples of effective and innovative online faculty development activities. It will conclude with a brief comment on evaluation and research.

Abstract Generative AI has disrupted the educational landscape for educators with increasing challenges to keep up with the explosive pace of AI as tools for teaching and learning, and within their practice. We will present our Mayo Clinic/Karolinska Institutet 24-hour global Promptathons, when 100s of health professions educators came together to learn together about and use generative AI in a supportive, inclusive environment. We leveraged experiential learning for digital mindsets and adaptive expertise, while wrestling with non-linear, complex challenges facing medical education, exploring how knowledge and skills can be co-created through shared experience. Qualitative and quantitative data was analyzed in alignment with the conceptual framework of adaptive expertise. Thematic analysis of chats, prompts and session transcripts suggest high levels of engagement, and adaptive experimentation with generative AI tools for teaching and learning. During two separate Promptathons 222 visitors, from 14 countries, engaged with guides and websites developed to facilitate the activity.

Adaptive expertise represents the combination of both efficient problem-solving for clinical encounters with known solutions, as well as the ability to learn and innovate when faced with a novel challenge. Fostering adaptive expertise requires careful approaches to instructional design to emphasize deeper, more effortful learning. These teaching strategies are time-intensive, effortful, and challenging to implement in health professions education curricula. The authors are educators whose missions encompass the medical education continuum, from undergraduate through to organizational learning. Each has grappled with how to promote adaptive expertise development in their context. They describe themes drawn from educational experiences at these various learner levels to illustrate strategies that may be used to cultivate adaptive expertise. At Vanderbilt University School of Medicine, a restructuring of the medical school curriculum provided multiple opportunities to use specific curricular strategies to foster adaptive expertise development. The advantage for students in terms of future learning had to be rationalized against assessments that are more short-term in nature. In a consortium of emergency medicine residency programs, a diversity of instructional approaches was deployed to foster adaptive expertise within complex clinical learning environments. Here the value of adaptive expertise approaches must be balanced with the efficiency imperative in clinical care. At Mayo Clinic, an existing continuous professional development program was used to orient the entire organization towards an adaptive expertise mindset, with each individual making a contribution to the shift. The different contexts illustrate both the flexibility of the adaptive expertise conceptualization and the need to customize the educational approach to the developmental stage of the learner. In particular, an important benefit of teaching to adaptive expertise is the opportunity to influence individual professional identity formation to ensure that clinicians of the future value deeper, more effortful learning strategies throughout their careers.

Introduction: The needs and expectations of health professional educators and learners are evolving. Therefore, physical and virtual learning environments will look and function differently in the future. Understanding desirable, feasible options for educators and learners, including online, in-person, hybrid, and extended realities, is critical. We designed and facilitated a faculty development workshop that adapted Lean Startup methodologies and role-modeled effective virtual teaching skills to engage stakeholders in generating ideas to inform future development of learning spaces within one national academic medical center. Methods: We facilitated the 3-hour workshop with an interprofessional group of health professional educators, learners, and administrative staff. The workshop included asynchronous prework and synchronous microlectures, small-group activities, and large-group report-outs. We employed Lean Startup methodologies to promote divergent thinking. Each small group had a dedicated convener and scribe. A designated chat moderator, social media facilitator, and several audiovisual staff provided support during the workshop. Results: More than 4,000 ideas were generated by the 350 participants. Participants reported that prework, microlectures, and small-group activities were successful in preparing them to engage in rapid idea generation and propose potential solutions for future learning spaces within health professions education. Discussion: The workshop, which utilized a rapid idea generation and Lean Startup methodologies format, was successful in producing an abundance of original ideas and potential solutions for future learning spaces within health professions education. As reported through postsession evaluation, participants valued the opportunity to contribute ideas and co-create potential solutions to guide future planning and feasibility studies.

Background A subgroup of patients with asthma has been reported to have an increased risk for asthma-associated infectious and inflammatory multimorbidities (AIMs). To systematically investigate the association of asthma with AIMs using a large patient cohort, it is desired to leverage a broad range of electronic health record (EHR) data sources to automatically identify AIMs accurately and efficiently. Methods We established an expert consensus for an operational definition for each AIM from EHR through a modified Delphi technique. A series of questions about the operational definition of 19 AIMS (11 infectious diseases and 8 inflammatory diseases) was generated by a core team of experts who considered feasibility, balance between sensitivity and specificity, and generalizability. Eight internal and 5 external expert panelists were invited to individually complete a series of online questionnaires and provide judgement and feedback throughout three sequential internal rounds and two external rounds. Panelists’ responses were collected, descriptive statistics tabulated, and results reported back to the entire group. Following each round the core team of experts made iterative edits to the operational definitions until a moderate (≥ 60%) or strong (≥ 80%) level of consensus among the panel was achieved. Results Response rates for each Delphi round were 100% in all 5 rounds with the achievement of the following consensus levels: (1) Internal panel consensus: 100% for 8 definitions, 88% for 10 definitions, and 75% for 1 definition, (2) External panel consensus: 100% for 12 definitions and 80% for 7 definitions. Conclusions The final operational definitions of AIMs established through a modified Delphi technique can serve as a foundation for developing computational algorithms to automatically identify AIMs from EHRs to enable large scale research studies on patient’s multimorbidities associated with asthma.

Objective: To address variance in clinical care surrounding sporadic vestibular schwannoma, a modified Delphi study was performed to establish a general framework to approach vestibular schwannoma care. A multidisciplinary panel of experts was established with deliberate representation from key stakeholder societies. External validity of the final statements was assessed through an online survey of registered attendees of the 8th Quadrennial International Conference on Vestibular Schwannoma. Study design: Modified Delphi method. Methods: The panel consisted of 16 vestibular schwannoma experts (8 neurotology and 8 neurosurgery) and included delegates representing the AAOHNSF, AANS/CNS tumor section, ISRS, and NASBS. The modified Delphi method encompassed a four-step process, comprised of one prevoting round to establish a list of focus areas and three subsequent voting rounds to successively refine individual statements and establish levels of consensus. Thresholds for achieving moderate consensus, at ≥67% agreement, and strong consensus, at ≥80% agreement, were determined a priori. All voting was performed anonymously via the Qualtrics online survey tool and full participation from all panel members was required before procession to the next voting round. Results: Through the Delphi process, 103 items were developed encompassing hearing preservation (N = 49), tumor control and imaging surveillance (N = 20), preferred treatment (N = 24), operative considerations (N = 4), and complications (N = 6). As a result of item refinement, moderate (4%) or strong (96%) consensus was achieved in all 103 final statements. Seventy-nine conference registrants participated in the online survey to assess external validity. Among these survey respondents, moderate (N = 21, 20%) or strong (N = 73, 71%) consensus was achieved in 94 of 103 (91%) statements, and no consensus was reached in 9 (9%). Of the four items with moderate consensus by the expert panel, one had moderate consensus by the conference participants and three had no consensus. Conclusion: This modified Delphi study on sporadic vestibular schwannoma codifies 100% consensus within a multidisciplinary expert panel and is further supported by 91% consensus among an external group of clinicians who regularly provide care for patients with vestibular schwannoma. These final 103 statements address clinically pragmatic items that have direct application to everyday patient care. This document is not intended to define standard of care or drive insurance reimbursement, but rather to provide a general framework to approach vestibular schwannoma care for providers and patients.

Background Interprofessional education (IPE) is a required component of training for all major health professions. A variety of instructional methods and activities have been adopted, however there is no widely-accepted review checklist to guide the creation and utilization of high quality and relevant IPE materials. Method A modified Delphi method was used to generate consensus around specific elements synonymous with high quality and relevant interprofessional education resources and instructional materials. The process included one pre-voting round with a convenience sample of 15 IPE professionals, and 3 subsequent rounds with an 8 member IPE expert panel from 6 institutions. Results The resulting IPE checklist includes 33 items grouped into categories of Content, Logistics and Assessment considerations. The checklist supports the development of new resources and evaluation of existing activities. Conclusions The modified Delphi process was a successful means to solicit expert feedback during the construction and iterative refinement of the IPE Checklist. The checklist will be useful in the design of new interprofessional education activities, and also in evaluating the quality of existing activities.