Andrew E. Krumm’s research while affiliated with Concordia University Ann Arbor and other places

... They emphasize that assessment systems work best when co-produced with stakeholders, including patients, healthcare professionals, patients, electronic health record vendors (designing metrics), health system leaders (integrating assessment into workflows), educators (ensuring assessors have skills and attitudes consistent with authentic assessment), and accreditors (incentivizing best practices systems implementation). 3. Krumm et al. [47] provide key questions to ask when seeking to harness technology for assessment. They discuss useful frameworks that can help strategically integrate technology into assessment practice. ...

Reference:

Introducing the Next Era in Assessment

... Among affective competencies, collaboration and participation in decision-making processes can be mentioned [25,26]. As pointed out by Singleton et al. [27], collaboration in scientific sensemaking is an important component in increasing students' interest in science. This understanding of learning inquiry competencies can be much broader than is usual in science. ...

Reference:

Inquiry-Based Approach in the Context of Undergraduate Teacher Training

... Therefore, clinical AI governance models can help in calling attention to the ways in which data collected by various technologies that are more proximal to practice in HPE are (1) processed by AI systems and (2) how different systems automatically recommend or enact interventions based on those data [31,32]. Developing AI governance models can help in highlighting a need to more rapidly evaluate both an AI system's performance and the potential harms of aligned decisions and actions. ...

Reference:

Proximity to Practice: The Role of Technology in the Next Era of Assessment

... As researchers have worked to understand how assessment data can be used to drive decision-making, barriers and facilitators to high quality implementation have emerged [18]. Lastly, as more and more tools are developed to algorithmically guide or enact decisions based on digital data sources, the ways in which algorithms are governed and evaluated have continued to evolve [19]. To help researchers work with data gathered from practice using various technologies, we next highlight three frameworks that could guide future research and development activities. ...

Reference:

Proximity to Practice: The Role of Technology in the Next Era of Assessment

... This complexity can cause difficulties for newly graduated surgeons. In the United States, data from the American Board of Surgery from 2007 to 2009 revealed higher mortality and severe complication rates among newly graduated surgeons than among their more seasoned counterparts [4]. However, technical proficiency is not necessarily correlated with experience [5]. ...

Reference:

A retrospective noninferiority study of laparoscopic inguinal hernia repair feasibility for recently graduated surgeons in Thailand

... A study by George and colleagues explored the interrelationship between educational outcomes and patient outcomes in a surgical context. 21 Their work suggests that the implications of medical education research go beyond learning outcomes and translate into outcomes related to surgical complications and the health and wellbeing of patients themselves. 21 Likewise, Weingartner and colleagues demonstrate that conducting research in medical education may improve clinical skills for pre-medical students, 22 and Teal and colleagues highlight the importance of education research funding to support nascent RIME scientists. ...

Reference:

Digging Deeper, Zooming Out: Reimagining Legacies in Medical Education

... Some learners may tolerate more ambiguity than others based on their prior knowledge. The diverse identities of learners and instructors, which have been previously suggested to affect post-operative communication, represent another area in which to study the manifestations of unscripted discourse during operations (Gates et al., 2023). Second, it would be useful to better understand other communication tools that facilitate instruction; for example, we speculate that measured repetition may help scaffold motor action. ...

Reference:

Ambiguity in robotic surgical instruction: lessons from remote and in-person simulation

... Although the NGSS were released over a decade ago, instruments for measuring the standards' impacts are only beginning to emerge, in part because the last decade has seen a focus on curriculum design (e.g., Reiser et al., 2021) and, more recently, curriculum-based PD (e.g., Lee et al., 2023;Lowell & McNeill, 2023). Emerging instruments elicit information about multiple aspects of contemporary science instruction, including teachers' knowledge, beliefs, and practices (e.g., Fulmer et al., 2021;Hayes et al., 2016;Nollmeyer & Bangert, 2017), classroom instruction (e.g., Chen & Terada, 2021;Martínez et al., 2022), and students' experiences (e.g., Campbell, Lee, Longhurst, et al., 2021;Penuel et al., 2023). These instruments employ a variety of data collection methods, including questionnaires (e.g., Fulmer et al., 2021), observation protocols (e.g., Chen & Terada, 2021), and electronic portfolios (e.g., Martínez et al., 2022). ...

Reference:

Development of a questionnaire on teachers' beliefs, preparedness, and instructional practices for teaching NGSS science with multilingual learners

... 49 In the GME surgical landscape, there is momentum around making such decisions for procedural skills. [50][51][52] Using probabilistic models, surgical educators demonstrated the ability to make predictions of future performance based on data from recent, prior performance. 50 While it unclear if or how such an approach would work in UME, it is important to recognise that the data used to inform aforementioned probabilistic models originated from WBAs interrogated for reliability and validity. ...

Reference:

How well do workplace‐based assessments support summative entrustment decisions? A multi‐institutional generalisability study

... 49 In the GME surgical landscape, there is momentum around making such decisions for procedural skills. [50][51][52] Using probabilistic models, surgical educators demonstrated the ability to make predictions of future performance based on data from recent, prior performance. 50 While it unclear if or how such an approach would work in UME, it is important to recognise that the data used to inform aforementioned probabilistic models originated from WBAs interrogated for reliability and validity. ...

Reference:

How well do workplace‐based assessments support summative entrustment decisions? A multi‐institutional generalisability study