David Williamson Shaffer’s research while affiliated with University of Wisconsin–Madison and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (85)


Clinical judgment, person-centered care and professionalism: A transmodal ordered network analysis of student performance in virtual patient simulations including those for text and data mining, AI training, and similar technologies. including those for text and data mining, AI training, and similar technologies. Clinical Simulation in Nursing 2
  • Article

November 2024

Clinical Simulation in Nursing

·

Amanda Davis

·

Muhammad H Ashiq

·

[...]

·

David Williamson Shaffer

Background: Few studies have connected nursing students' performance in simulations to clinical compe-tencies exemplified in The Essentials and the NCJMM. This retrospective study examined the effectiveness of screen-based virtual patient simulations (VPS) in facilitating ten undergraduate prelicensure students' practice of clinical judgment, person-centered care, and professionalism. Methods: Multimodal transcripts capturing patient interactions, exam actions, and documentation in a gerontology and mental health scenario were analyzed using Transmodal Ordered Network Analysis (T/ONA). We examined the strength and order of connections students made to recognizing cues, analyzing cues, diagnosing and prioritizing hypotheses, generating solutions, evaluating outcomes, subjective assessment, therapeutic communication, and care-management and coordination. Findings: Both scenarios afforded opportunities for students to gather comprehensive data and make evidence-based and patient-centered care decisions. However, students' patterns of connection making were significantly different for virtual patients who presented palliative care versus mental health care needs. Conclusion: The assurance for nursing students' practice readiness can be realized through careful implementation of diverse assignment types and scenarios in VPS. T/ONA provides a novel and systematic approach for studying student behaviors in simulations.



Fig. 4 Averaged network subtractions for low (red edges) and high (blue edges) performing teams in spaces for primary tasks during the initial assessment (phase 2).
Fig. 5 Averaged network subtractions for low (red edges) and high (blue edges) performing teams in spaces for primary tasks during the resolving emergency ( phase 3).
Fig. 6 Averaged network subtractions for low (red edges) and high (blue edges) performing teams in spaces for secondary tasks during the initial assessment (phase 2).
Teamwork communication coding scheme and corresponding definition, example, and inter-rater reliability.
Ordered Networked Analysis of Multimodal Data in Healthcare Simulations: Dissecting Team Communication Tactics
  • Preprint
  • File available

August 2024

·

47 Reads

In highly immersive, team-based healthcare simulations, students must collaborate effectively to complete open-ended learning tasks. These often require students to move among multiple locations within the physical learning space, 1 requiring the development of effective communication tactics to manage complex team dynamics and multiple concurrent dialogue segments. Analysing such distributed team dialogue using only audio data poses significant challenges as it is hard to distinguish how teams temporarily break into smaller groups. This study investigates the integration of audio and spatial data to model embodied team communication tactics in highly-dynamic healthcare simulation scenarios. We employ ordered network analysis (ONA) to examine the order of communication behaviours across coded co-located dialogue segments of teams of nursing students. We also explore the potential of ONA to enhance teaching through a qualitative assessment of its usability with teachers. Results reveal that high-performing teams employ effective team tactics by prioritising primary tasks (i.e., deteriorating patients) and performing critical tasks timely and correctly, while low-performing teams struggle to develop prioritisation tactics (i.e., focus-ing on stable patients) and with team coordination. Interviews with teachers found high-level information in ONA networks interpretable but faced challenges with sequential details and contextualisation. This research offers insights into improving team-based learning and assessment in healthcare education.

Download

Fig. 2 Two-dimensional illustration of the authenticity dilemma
Fig. 3 Reconceptualizing the authenticity dilemma through thick authenticity
The authenticity dilemma: towards a theory on the conditions and effects of authentic learning

August 2024

·

118 Reads

·

2 Citations

European Journal of Psychology of Education

A highly authentic learning setting is likely to trigger positive motivational and emotional reactions due to its emphasis on promoting the acquisition of knowledge that is connected and transferable to real-world phenomena outside the learning environment. However, a high level of authenticity is usually accompanied by a high level of complexity due to the complexity inherent in the real world. This complexity can be overwhelming for learners and can hamper or even prevent cognitive learning outcomes. Consequently, to help learners cope with this complexity, they need some kind of instructional support. By building a high level of support into the learning setting in order to promote cognitive learning outcomes, the level of authenticity and thereby the effects of authenticity on motivational outcomes may, however, in turn be reduced. In the present conceptual paper, we refer to this tension between authenticity and complexity, on the one hand, and instructional support, on the other hand, as the “authenticity dilemma”. Based on existing empirical evidence from previous studies, we (1) outline this dilemma, (2) discuss ways to reconceptualize it, and (3) derive implications regarding the conditions and effects of authentic learning. Finally, we discuss the findings of the studies included in the special issue “Perspectives on Authentic Learning” through the lens of the authenticity dilemma.


Epistemic Network Analysis and Ordered Network Analysis in Learning Analytics

June 2024

·

95 Reads

·

3 Citations

This chapter provides a tutorial on conducting epistemic network analysis (ENA) and ordered network analysis (ONA) using R. We introduce these two techniques together because they share similar theoretical foundations, but each addresses a different challenge for analyzing large-scale qualitative data on learning processes. ENA and ONA are methods for quantifying, visualizing, and interpreting network data. Taking coded data as input, ENA and ONA represent associations between codes in undirected or directed weighted network models, respectively. Both techniques measure the strength of association among codes and illustrate the structure of connections in network graphs, and they quantify changes in the composition and strength of those connections over time. Importantly, ENA and ONA enable comparison of networks both visually and via summary statistics, so they can be used to explore a wide range of research questions in contexts where patterns of association in coded data are hypothesized to be meaningful and where comparing those patterns across individuals or groups is important.



iPlan: A Platform for Constructing Localized, Reduced-Form Models of Land-Use Impacts

April 2024

·

30 Reads

Multimodal Technologies and Interaction

To help young people understand socio-environmental systems and develop the confidence that meaningful action can be taken to address socio-environmental problems, young people need interactive simulations that enable them to take consequential actions in a familiar context and see the results. This can be achieved through reduced-form models with appropriate user interfaces, but it is a significant challenge to construct a system capable of producing educational models of socio-environmental systems that are localizable and customizable but accessible to educators and learners. In this paper, we present iPlan, a free, online educational software application designed to enable educators and middle- and high-school-aged learners to create custom, localized land-use simulations that can be used to frame, explore, and address complex land-use problems. We describe in detail the software application and its underlying computational models, and we present robust evidence that the accuracy of iPlan simulations is appropriate for educational contexts and preliminary evidence that educators are able to produce simulations suitable for their pedagogical goals and learner populations.



A feasibility study for a unified, multimodal analysis of online information foraging in health-related topics

March 2024

·

9 Reads

Background Digital health literacy (DHL) is the ability to find, understand, and appraise online health-related information, as well as apply it to health behavior. It has become a core competence for navigating online information and health service environments. DHL involves solving ill-structured problems, where the problem and its solution are not clearcut and may have no single answer, such as in the process of sensemaking. We employ and expand on information foraging theory to address how experts and novices in information retrieval perform a search task. Our overarching aim is to pinpoint best practices and pitfalls in understanding and appraising health-related information online to develop a digital intervention to increase DHL and critical thinking. Methods In this feasibility study, we recruited a total of twenty participants for our expert and novice subsamples. We collected sociodemographic data with a self-developed survey, video data through an observation protocol of a 10-minute search task, as well as audio-video data via a retrospective think-aloud. The three, multimodal data streams were transcribed and aligned. Codes were developed inductively in several iterations, then applied deductively to the entire dataset. Tabularized, coded and segmented qualitative data were used to create various quantitative models, which demonstrate viability for the qualitative and statistical comparison of our two subsamples. Results Data were visualized with Epistemic Network Analysis to analyze code co-occurrences in the three aligned data streams, and with Qualitative/Unified Exploration of State Transitions to examine the order in which participants in our two subsamples encountered online content. Conclusions This paper describes our methods and planned analyses elaborated with mock figures. Quantifying qualitative data, aligning data streams, and representing all information in a tabularized dataset allows us to group data according to various participant attributes and employ data visualization techniques to pinpoint patterns therein.



Citations (65)


... For example, research could explore how this study's interpretation and operationalisation of an ill-defined activity contributed to the outcomes. Moreover, our findings should be examined in light of the recently conceptualised authenticity dilemma, which highlights the interplay between levels of authenticity and complexity, the guidance and structure provided, and how these factors influence the cognitive and motivational effects of the activity (Nachtigall et al., 2024). Meanwhile, there is accumulating evidence indicating that the Phenom SEM device serves as an excellent tool for providing science students and teachers with authentic scientific experiences. ...

Reference:

The SEMinal impact of contemporary science: integrated authentic science design and students' self-efficacy and career aspirations
The authenticity dilemma: towards a theory on the conditions and effects of authentic learning

European Journal of Psychology of Education

... In this framework, nodes represent coded interaction elements, and edges represent their co-occurrence within a time window [28]. However, despite its strengths, ENA primarily focuses on the co-occurrence of elements and cannot model directed transitions between learning states, limiting its ability to fully capture temporal learning dynamics [29]. Ordered Network Analysis (ONA) can model directed, weighted networks, allowing for the analysis of the order in which learning events occur [29]. ...

Epistemic Network Analysis and Ordered Network Analysis in Learning Analytics

... The utterances included a variety of interactions logged between students, patients and the VPS across three modalities and distinct phases in a focused exam assignment. These interactions characterize student behavior in the VPS and provide insight into how, where, and when students make connections to clinical competencies in a scenario ( Ashiq et al., 2024 ). For instance, the dialog data captured students questioning patients to obtain relevant data. ...

Illustrating the Interplay of Behavioral Patterns and Clinical Competencies in a Virtual Patient Simulation using Epistemic Network Analysis

... MMLA seeks to provide a more holistic view of the classroom, as it may capture traces of teacher and student behaviors (such as student engagement, performance, cognition, and emotional states), thereby enabling a more informed approach to teachers' reflection on instruction and learning. While analytics can offer valuable insights into teaching and learning processes, there is a significant gap in understanding which data elements and analytics are most beneficial for teachers [2,25]. Recent literature reviews reported that MMLA solutions often focus on developing computational models, capabilities, and analytics for research purposes rather than researching stakeholder preferences, privacy concerns, and reluctance to share sensitive data [1,25]. ...

Revealing Networks: Understanding Effective Teacher Practices in AI-Supported Classrooms using Transmodal Ordered Network Analysis

... The ability to convey ideas concisely, logically, and persuasively empowers students to articulate their thoughts, engage in critical discourse, and contribute to knowledge construction. Writing proficiency serves as a bridge between academic achievement and effective communication in real-world contexts (Kang et al., 2024;Guo, 2023;Banat, 2023). ...

Unveiling joint attention dynamics: Examining multimodal engagement in an immersive collaborative astronomy simulation
  • Citing Article
  • February 2024

Computers & Education

... In addition, further research is needed on how iPlan improves learning. As we argue elsewhere [60], the more customizable an educational experience is, the more difficult it is to design learning analytic models or assessment systems that can be reliably used to measure learning. In other words, constructing normative assessments of learning in complex learning environments when neither the content nor the context is standardized presents significant challenges [61]. ...

Thin Data, Thick Description: Modeling Socio-Environmental Problem-Solving Trajectories in Localized Land-Use Simulations
  • Citing Chapter
  • October 2023

Communications in Computer and Information Science

... Guided by The Essentials and NCJMM, we investigated ten students' practices of clinical judgment, person-centered care and professionalism in two focused exam assignments using screen-based VPS. Multimodal transcripts capturing patient interactions, exam actions and documentation in a gerontology and mental health scenario were retrospectively analyzed using advanced learning analytics methods; namely, we used Transmodal Ordered Network Analysis (T/ONA, Wang et al., 2023 ;Tan et al., 2022 ). Notably, we build upon the foundational work established by Wang and colleagues (2023) who applied T/ONA to examine two students' performance in VPS in two assignment types and scenarios from three content areas. ...

Developing Nursing Students’ Practice Readiness with Shadow Health® Digital Clinical ExperiencesTM^{\textrm{TM}}: A Transmodal Analysis
  • Citing Chapter
  • October 2023

Communications in Computer and Information Science

... Nasir et al. [32] employed video, audio and log data to characterize the learning behavioral profiles of dyads. Yan et al. [51] categorized students into two groups based on their perceived stress, collaboration, and task satisfaction in small-group embodied teamwork. The differences in procedural and social behavior features between the different groups were analyzed using ordered network analysis (ONA). ...

Characterising Individual-Level Collaborative Learning Behaviours Using Ordered Network Analysis and Wearable Sensors

Communications in Computer and Information Science

... Explicit self-regulated strategy teaching's beneficial effects on students' writing skills have led to the development of practice-based professional development (PBPD) to help teachers apply explicit teaching in their classrooms McKeown et al., 2016McKeown et al., , 2023McKeown, FitzPatrick McKeown et al., 2019a, b). Teachers found PBPDs to be useful (Finlayson & McCrudden, 2021;, 2021McKeown et al., 2016McKeown et al., , 2019aMcKeown, FitzPatrick McKeown et al., 2019a, b), and several studies have indicated that training teachers to apply the SRSD approach in real-life class situations also significantly affected the quality of pupils' texts McKeown, FitzPatrick McKeown et al., 2019a, b, 2023, provided that teachers faithfully applied each step of the various sessions (McKeown, FitzPatrick McKeown et al., 2019a, b). Altogether, these beneficial effects are tied to SRSD interventions helping students develop important self-regulation abilities, including the use of effective writing strategies in planning their texts, accurately monitoring the progress of the writing process, and efficiently adapting their writing based on their monitoring output. ...

Analytics of self-regulated learning scaffolding: effects on learning processes

... Yet, the Data Storytelling Editor designed has not only been used for data collection but also to support teamwork research. For example, the collected data may offer new opportunities to explore different modalities of embodied team activity, as presented in recent work by Zhao et al. [47,48] who combined audio and positioning data. ...

Analysing Verbal Communication in Embodied Team Learning Using Multimodal Data and Ordered Network Analysis

Lecture Notes in Computer Science