About
198
Publications
53,912
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,577
Citations
Introduction
Additional affiliations
September 2012 - December 2016
May 1999 - August 2012
Honeywell Laboratories
Position
- Group Leader
Publications
Publications (198)
Team skill metrics were operationalized by translating team constructs to metrics based on observable behaviors. As human coordination with autonomous agents turns to collaboration, humans may increasingly view agents as teammates. This transition will require agents to possess team skills and necessitate appropriate metrics for measuring team skil...
Teamwork assessment requires research environments that replicate the task complexity and induce challenges and uncertainty. Gamified environments are gaining attention as suitable environments for teamwork assessment, where teaming behaviors can be quantified. However, further research is needed to establish the relationship between gaming mechani...
Multiple tools are available to reduce cybersickness (sickness caused by virtual reality), but past research has not investigated the combined effects of multiple mitigation tools. Field of view (FOV) restriction limits peripheral vision during self-motion, and ample evidence supports its effectiveness for reducing cybersickness. Snap turning invol...
This paper describes a comprehensive framework for the development of an extended reality (XR) authoring toolkit for general aviation weather training. Conventional weather training methods often rely on static, text-based materials, which might result in limited engagement and failure to provide an immersive experience tailored to the unique learn...
The majority of food in the US is distributed through global/national supply chains that exclude locally-produced goods. This situation offers opportunities to increase local food production and consumption and is influenced by constraints that limit the scale of these activities. We conducted a study to assess perspectives of producers and consume...
This paper developed human-autonomy teaming (HAT) characteristics and requirements by comparing and synthesizing two aerospace case studies (Single Pilot Operations/Reduced Crew Operations and Long-Distance Human Space Operations) and the related recent HAT empirical studies. Advances in sensors, machine learning, and machine reasoning have enabled...
Current aviation weather training for novice pilots provides limited opportunities to practice correlating information in weather-related situations to develop cognitive skills. Current training materials are largely print based: restricted to text and two-dimensional images. However, interactive print training materials can include interactive aug...
Local food systems, in which consumers source food from nearby farmers, offer a sustainable alternative to the modern industrial food supply system. However, scaling up local food production to meet consumer demand will require farmers to allocate more land to this purpose. This paper describes an agent-based model that represents commodity-produci...
Widespread adoption of virtual reality (VR) will likely be limited by the common occurrence of cybersickness. Cybersickness susceptibility varies across individuals, and previous research reported that interpupillary distance (IPD) may be a factor. However, that work emphasized cybersickness recovery rather than cybersickness immediately after expo...
Cybersickness is a barrier to widespread adoption of virtual reality (VR). We summarize the literature and conclude that women experience more cybersickness than do men, but that the size of the gender effect is modest. We present a mediation and moderation framework for organizing existing research and proposing new questions about gender and cybe...
Cybersickness is a barrier to widespread adoption of virtual reality (VR). We summarize the literature and conclude that women experience more cybersickness than do men, but that the size of the gender effect is modest. We present a mediation and moderation framework for organizing existing research and proposing new questions about gender and cybe...
Widespread adoption of virtual reality (VR) will likely be limited by the common occurrence of cybersickness. Cybersickness susceptibility varies across individuals, and previous research reported that interpupillary distance (IPD) may be a factor. However, that work emphasized cybersickness recovery rather than cybersickness immediately after expo...
When training for hazardous operations, real-time stress detection is an asset for optimizing task performance and reducing stress. Stress detection systems train a machine-learning model with physiological signals to classify stress levels of unseen data. Unfortunately, individual differences and the time-series nature of physiological signals lim...
Automated agent technology in video games is a form of artificial intelligence (AI) that interacts with humans, and thus can provide interactive skills training via human-agent interaction. Having a good framework for agent types could help industry agent designers make best use of agents’ capabilities. This research extends the previously establis...
This research aims to understand how cooperative game features lead to teamwork behaviors as a step in developing gamified testbeds where human-human and human-autonomy teaming can be evaluated. Multiplayer video games incorporate features that encourage cooperation and interdependency, making them potential task environments for evaluating team me...
This paper aims at exploring whether a single team performance management system could effectively monitor team communication within active firefights in both real and simulated environments. While individual skills training in military settings has undergone extensive research, work focused on contrasting team constructs within real and simulated...
A testbed has been developed to study multiple constructs of teamwork in a parameterized environment. MazeWorld is a testbed to learn and automate the collection of objective team metrics based on observable behaviors. Quantifying teamwork plays an important role in future agent cooperation. Challenges include differentiating individual skills from...
This study explored the impact of task workload on virtual reality (VR) cybersickness. Cybersickness is a negative side effect of using VR to which many users are susceptible. Previous research on the impact on task workload on cybersickness has yielded no consistent relationships, but given that task workload requires attentional resources, it is...
View Video Presentation: https://doi.org/10.2514/6.2022-3780.vid The objective of this work was to evaluate whether augmented reality (AR) can be used to improve how general aviation (GA) student pilots learn about weather and correspondingly make weather-related decisions during flight operations. Literature about the weather in general aviation,...
What makes an autonomous system a teammate? The paper presents an evaluation of factors that can encourage a human perceive an autonomous system as a teammate rather than a tool. Increased perception of teammate-likeness more closely matches the human’s expectations of a teammate’s behavior, benefiting coordination and cooperation. Previous work wi...
roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> Objective :
We designed, developed, and evaluated a 3D augmented reality (AR) weather visualization to investigate whether it could enhance communication about weather in general aviation (GA) education.
Background :
Evaluations of GA weather trainin...
The Reading the Mind in the Eyes Test (RMET) has received attention due to its correlation with collective intelligence. If the RMET is a marker of collective intelligence, training to improve RMET could result in better teamwork, whether for human-human or human-AI (artificial intelligence) in composition. While training on related skills has prov...
Virtual reality (VR) provides the ability to simulate stressors to replicated real-world situations. It allows for the creation and validation of training, therapy, and stress countermeasures in a safe and controlled setting. However, there is still much unknown about the cognitive appraisal of stressors and underlying elements. More research is ne...
Training systems are a potential stress countermeasure by simulating high stress conditions in a safe and controlled environment. Training often involves increasing the complexity of scenarios over time until trainees can reliably execute the task. However, several limitations reduce the long-term retention and robustness of training during intense...
Sensor-based vision systems enable approaches to altitudes closer to the runway in low visibility conditions. These systems utilize imaging sensors capable of providing forward vision of the runway and the resulting imagery is displayed on a head-up display. Previous studies were primarily limited to nominal cases. Off-nominal cases assessments are...
Characteristics of a virtual reality user are known to affect cybersickness, but the specific role of individual differences, such as personality, is largely unknown. This study addressed this gap through examination of subjective recall survey data relating to experiences in virtual reality, including severity of cybersickness symptoms, cybersickn...
This research details the development of a human-agent team (HAT) analysis framework specifically aimed at video games. The framework identifies different dimensions of interest related to humans and software agents working together. Video games have a variety of user-tested interaction paradigms that may offer useful insights into HAT dynamics, bu...
This work evaluates augmented reality (AR) training materials for general aviation (GA) weather training. Reviews of GA weather training identify gaps where students lack opportunities to experience weather patterns and lack the ability to correlate weather knowledge in weather-related situations. Three-dimensional (3D) visual models may help close...
Astronauts operate in an environment with multiple hazards that can develop into life-threatening emergency situations. Managing stress in emergencies may require cognitive resources and lead to diminishing performance. Stress training aims to maintain performance under stress by methodically increasing stressor levels to build inoculation against...
Characteristics of a virtual reality user are known to affect cybersickness, but the specific role of individual differences, such as personality, is largely unknown. This study addressed this gap through examination of subjective recall survey data relating to experiences in virtual reality, including severity of cybersickness symptoms, cybersickn...
View Video Presentation: https://doi.org/10.2514/6.2021-2953.vid Augmented reality (AR) learning experiences were designed for general aviation (GA) weather training to enhance students understanding of aviation weather information. Students inside and outside the classroom lack opportunities to experience different types of weather patterns and pr...
Most people in the world live in urban areas, and their high population densities, heavy reliance on external sources of food, energy, and water, and disproportionately large waste production result in severe and cumulative negative environmental effects. Integrated study of urban areas requires a system-of-systems analytical framework that include...
A Playbook delegation approach was evaluated for human-autonomy teaming (HAT) in Single Pilot Operations (SPO). In SPO, a single pilot makes flight decisions, performs flight tasks, and collaborates with an autonomous teammate. The autonomous teammate shares responsibility, authority, and tasks. Challenges include the design of functions, interacti...
This research assessed how the performance and team skills of three-person teams working with an Intelligent Team Tutoring System (ITTS) on a virtual military surveillance task were affected by feedback privacy, participant role, task experience, prior team experience, and teammate familiarity. Previous work in Intelligent Tutoring Systems (ITSs) h...
This chapter describes best practices for adapting traditional, face‐to‐face, team‐based learning principles to develop online application exercise design, support effective facilitation, and use appropriate technology to promote effective online team collaboration. The unique challenges of online TBL applications include maintaining effective team...
Background
Transdisciplinary translational science applies interdisciplinary approaches to the generation of novel concepts, theories and methods involving collaborations among academic and non-academic partners, in order to advance the translation of science into broader community practice.
Objective
This paper introduces a special issue on trans...
This work documents the use of Ecological Momentary Assessment (EMA) to gather data on household behaviors related to outdoor temperatures. In order for urban decision-makers to take effective action to address heat events, they must understand vulnerable residents’ current practices in relation to outdoor temperature. However, vulnerable residents...
This paper describes the requirements and overall design of a testbed for a human-agent team. A robust, flexible testbed will enable researchers to evaluate the effectiveness of human-agent teaming concepts and issues. In the testbed, MazeWorld, multiple agents play different roles in which tasks are interdependent. Each role can be served by a hum...
This work aimed to identify cognitive skills associated with flight planning, suggest which skills might be susceptible to skill degradation, and investigate the effects of cognitive skill degradation over time. Information automation systems offload cognitive tasks to reduce workload and error. However, the same phenomena seen with physical skill...
Virtual reality (VR) usage continues to grow, but visually induced motion sickness (VIMS) can decrease VR effectiveness for some users. This study seeks to compare methods of VIMS mitigation and explore sickness among gender and video game experience groups. Participant discomfort and early dropout are problems for studies that involve virtual envi...
Graduated stress exposure aims to alleviate the negative effects of stress on task performance during high-stress conditions. Skills are practiced in increasing stress conditions that approximate the operational environment. Practice continues until stress resilience and task proficiency are achieved. The use of virtual reality (VR) for inducing a...
Climate predictions indicate a strong likelihood of more frequent, intense heat events. Resource-vulnerable, low-income neighbourhood populations are likely to be strongly impacted by future climate change, especially with respect to an energy burden. In order to identify existing and new vulnerabilities to climate change, local authorities need to...
Do physical and psychosocial stressors interact to increase stress in ways not explainable by the stressors alone? A preliminary study compared participants’ stress response while subjected to a physical stressor (reduced or full physical load) and a predetermined social stressor (confronted by calm or aggressive behavior). Salivary cortisol sample...
This paper represents the development and the design of a Playbook interface which supports the coordination between human and autonomous teammates in Single Pilot Operations. The move from Dual-Pilot Operations to Single Pilot Operations necessitates that the autonomous teammate will perform some of the functions which are performed by pilots in D...
As urban areas face uncertain climate futures, leaders are challenged with making decisions to mitigate the effects of climate events on vulnerable populations. However, these populations have historically been excluded from many parts of the decision-making process. To promote more equitable decision-making, an inclusive, data-driven decision supp...
As zero energy buildings take on an increasingly prominent role in overall efforts to reduce energy consumption, it is necessary to identify effective policies for their design and implementation. However, current zero energy building (ZEB) policies focus mainly on new buildings, primarily through on-site renewable energy generation, such as roofto...
Residential consumers in the U.S. have demonstrated a growing interest in rooftop photovoltaic (PV) systems, resulting in increased adoption over the last decade. However, this has diminished utility revenues, and policymakers have expressed concerns about inequitable consumer access to publicly-funded rooftop PV adoption incentives. In response to...
Objective:
The goal of this work is to determine whether muscular fatigue concurrently reduces cognitive attentional resources in technical tasks for healthy adults.
Background:
Muscular fatigue is common in the workplace but often dissociated with cognitive performance. A corpus of literature demonstrates a link between muscular fatigue and cog...
Enhanced Flight Vision Systems (EFVS) enables approaches to altitudes closer to the runway that would otherwise be precluded due to low visibility ceilings. EFVS in flight cockpits has the potential to augment the safety in flight operations and enable improved crew performance during approach and landing phases of flight irrespective of the visibi...
This research developed methods for a virtual operator model (VOM) to learn the optimal control inputs for operation of a virtual excavator. Virtual design, used to model, simulate, and test new features, has often been limited by the fidelity of the virtual model of human operators. Human operator learns, over time, the capability, limits, and con...
Weatherizing residential buildings to make them more energy efficient offers great potential for reducing greenhouse gas emissions, conserving resources, and improving occupant comfort and well-being in the face of climate change. However, weatherization adoption rates remain low. Previous research suggests that social norms and energy-related inte...
This paper describes the development and evaluation of an Intelligent Team Tutoring System (ITTS) for pairs of learners working collaboratively to monitor an area. In the Surveillance Team Tutor (STT), learners performed a surveillance task in a virtual environment, communicating to track hostile moving soldiers. This collaborative problem solving...
The Human Factors and Ergonomics Society Diversity Committee is entering its second year and continuing to explore ways to increase the diversity of the society. Following last year’s panel on “Challenges and Opportunities for Involvement,” we, and others, recognized that human factors and ergonomics (HFE) professionals are equipped and able to adv...
Challenges arise when developing a computer-based Intelligent Team Tutoring System (ITTS) that attempts to deliver feedback to teams as effectively as a human tutor. The purpose of this current work is to outline elements of feedback that should be considered when designing feedback for an ITTS. The authors present the results of a study that consi...
This work surveyed residents of an economically disadvantaged community on their attitudes toward weatherization and their energy use behaviors. To support urban leaders making decisions to mitigate the effects of large-scale climate change, data-driven simulation models are being developed. To ensure that these models are equitable, the needs of a...
Designers of human-agent interaction techniques may benefit from an analysis of existing video games that include aspects of human-agent teaming. Many popular multi-player video games have been designed to integrate multiple human and computer agents in pursuit of a common objective and can serve as a testbed to explore novel interaction methods in...
The Reading the Mind in the Eyes (RME) test was originally developed to help distinguish between persons with and without autism (Baron-Cohen et al., 2001). Recently the RME test has been shown to relate to a collective intelligence, defined as the ability of a group to perform a wide variety of tasks (Woolley et al., 2010). While these previous re...
This study investigated how simulated features in a virtual reality (VR) induce stress by means of user-focused demands in serious games. VR serious games have been used for therapeutic interventions, standardized stress tests, and occupational training. However, it is an open question how stress can be induced using serious games formal features,...
In our paper we discuss an intelligent team tutoring system (ITTS) developed for a computer-based surveillance task experiment. In the experiment, two teammates worked together in a shared Virtual Battlespace 2 environment, and tutoring was provided by the Generalized Intelligent Framework for Tutoring. Feedback was triggered by the actions that th...
Facilitated-voluntary geographic information (f-VGI) is a promising method to enable systematic collection of data from residents about their physical and social environment. The method capitalizes on ubiquitous mobile smartphones to empower collection of geospatially-referenced data. It is important to evaluate the validity of user-generated conte...
To advance construction machine design and testing, model-based design and virtual operator models (VOMs) can be used to explore machine designs virtually. However, current VOM efforts have been restricted to mimicking known trajectories, recorded from actual machine operations. Previous work developed a VOM to use in closed-loop simulation with an...
Human–automation etiquette applies human–human etiquette conventions to human–computer interaction (HCI). The research described in this paper investigates how to mitigate user frustration and support student learning through changes in the style in which a computer tutor interacts with a learner. Frustration can significantly impact the quality of...
Psychological and physiological stress experienced by astronauts can pose risks to mission success. In clinical settings, gradually increasing stressors help patients develop resilience. It is unclear whether graduated stress exposure can affect responses to acute stressors during spaceflight. This study evaluated psychophysiological responses to p...
Intelligent tutoring systems, having been relatively successful at emulating the results of human tutors for certain learning domains, are now being developed for team tutoring. With the addition of multiple humans in the system, modeling the communication and coordination between the humans and the tutoring agent grows combinatorically and present...
Objective:
We investigated adapting the interaction style of intelligent tutoring system (ITS) feedback based on human-automation etiquette strategies.
Background:
Most ITSs adapt the content difficulty level, adapt the feedback timing, or provide extra content when they detect cognitive or affective decrements. Our previous work demonstrated th...
In order to provide some guidance for preventing human interface problems that could affect human performance and safety during a space mission, this chapter on human-system interface design primarily covers the design of the cockpit, from a technical and process point of view, and the related design of visual-aural alert system and crew seats. In...