Francesco Chiossi

Ludwig-Maximilians-Universität in Munich | LMU · Department of Mathematics - Informatics and Statistics

Mixed reality enables users to immerse themselves in high-workload interaction spaces like office work scenarios. We envision physiologically adaptive systems that can move users into different mixed reality manifestations, to improve their focus on the primary task. However, it is unclear which manifestation is most conducive for high productivity...

Biosensing technologies are on their way to becoming ubiquitous in multimedia interaction. These technologies capture physiological data, such as heart rate, breathing, skin conductance, and brain activity. Researchers are exploring biosensing from perspectives including engineering, design, medicine, mental health, consumer products, and interacti...

Virtual reality (VR) finds various applications in productivity, entertainment, and training, often requiring substantial working memory and attentional resources. Effective task performance in VR relies on prioritizing relevant information and suppressing distractions through internal attention. However, current VR systems fail to account for the...

Future VR environments envision adaptive and personalized interactions. To this aim, attention detection in VR settings would allow for diverse applications and improved usability. However, attention-aware VR systems based on EEG data suffer from long training periods, hindering generalizability and widespread adoption. This work addresses the chal...

Mixed Reality allows us to integrate virtual and physical content into users' environments seamlessly. Yet, how this fusion affects perceptual and cognitive resources and our ability to find virtual or physical objects remains uncertain. Displaying virtual and physical information simultaneously might lead to divided attention and increased visual...

Future VR environments will sense users' context, enabling a wide range of intelligent interactions, thus enabling diverse applications and improving usability through attention-aware VR systems. However, attention-aware VR systems based on EEG data suffer from long training periods, hindering generalizability and widespread adoption. At the same t...

Transitioning seamlessly from the real world into the digital world through the mixed reality continuum remains challenging. This paper investigates transitional design principles across the MR spectrum , anchored by a review of "The MagicBook", a pioneering work that introduced the concept of transitional interfaces to the HCI community. Employing...

The 2nd Joint Workshop on Cross Reality (JWCR'24), organized as part of ISMAR 2024, seeks to explore the burgeoning field of Cross Reality (CR), which encompasses the seamless integration and transition between various points on the reality-virtuality continuum (RVC) such as Virtual Reality (VR), Augmented Virtuality (AV), and Augmented Reality (AR...

While Mixed Reality allows the seamless blending of digital content in users' surroundings, it is unclear if its fusion with physical information impacts users' perceptual and cognitive resources differently. While the fusion of digital and physical objects provides numerous opportunities to present additional information, it also introduces undesi...

The 2nd Joint Workshop on Cross Reality (JWCR'24), organized as part of ISMAR 2024, seeks to explore the burgeoning field of Cross Reality (CR), which encompasses the seamless integration and transition between various points on the reality-virtuality continuum (RVC) such as Virtual Reality (VR), Augmented Virtuality (AV), and Augmented Reality (AR...

When using Head-Mounted Displays (HMDs), users may not always notice or report visual discomfort by blurred vision through unadjusted lenses, motion sickness, and increased eye strain. Current measures for visual discomfort rely on users' self-reports those susceptible to subjective differences and lack of real-time insights. In this work, we inves...

Physiologically-adaptive Virtual Reality systems dynamically adjust virtual content based on users' physiological signals to enhance interaction and achieve specific goals. However, as different users' cognitive states may underlie multivariate physiological patterns, adaptive systems necessitate a multimodal evaluation to investigate the relations...

People are increasingly eager to know more about themselves through technology. To date, technology has primarily provided information on our physiology. Yet, with advances in wearable technology and artificial intelligence, the current advent of consumer neurotechnology will enable users to measure their cognitive activity. We see an opportunity f...

Recently, we saw a trend toward using physiological signals in interactive systems. These signals, offering deep insights into users' internal states and health, herald a new era for HCI. However, as this is an interdisciplinary approach, many challenges arise for HCI researchers, such as merging diverse disciplines, from understanding physiologica...

Developed a VR adaptive system utilizing EEG correlates of external and internal attention to optimizing task performance and user engagement. • Demonstrated the effectiveness of online adaptation using EEG correlates of attention, resulting in efficient user model. • We adapted peripheral environmental factors rather than manipulating main task fe...

Social games benefit from social connectedness between players because it improves the gaming experience and increases enjoyment. In virtual reality (VR), various approaches, such as avatars, are developed for multi- player games to increase social connectedness. However, these approaches are lacking in single-player games. To increase social conne...

While Human-Computer Interaction (HCI) has contributed to demonstrating that physiological measures can be used to detect cognitive changes, engineering and machine learning will bring these to application in consumer wearable technology. For HCI, many open questions remain, such as: What happens when this becomes a cognitive form of personal infor...

Biocybernetic loops encompass users' state detection and system adaptation based on physiological signals. Current adaptive systems limit the adaptation to task features such as task difficulty or multitasking demands. However, virtual reality allows the manipulation of task-irrelevant elements in the environment. We present a physiologically adapt...

Virtual reality experiences increasingly use physiological data for virtual environment adaptations to evaluate user experience and immersion. Previous research required complex medical-grade equipment to collect physiological data, limiting real-world applicability. To overcome this, we present SensCon for skin conductance and heart rate data acqu...

During listening to music, the brain expects specific acoustic events based on learned musical rules. During music performance expectancy is additionally created based on motor action by linking keypresses to their sounds. We investigated EEG (Electroencephalography) signals to auditory expectancy violations in piano performance and perception. In...

Social media platforms use short, highly engaging videos to catch users' attention. While the short-form video feeds popularized by TikTok are rapidly spreading to other platforms, we do not yet understand their impact on cognitive functions. We conducted a between-subjects experiment (N= 60) investigating the impact of engaging with TikTok, Twitte...

Physiologically-adaptive Virtual Reality can drive interactions and adjust virtual content to better fit users' needs and support specific goals. However, the complexity of psychophysiological inference hinders efficient adaptation as the relationship between cognitive and physiological features rarely show one-to-one correspondence. Therefore, it...

Mixed Reality (MR) allows users to interact with digital objects in a physical environment, but several limitations have hampered widespread adoption. Physiologically adaptive systems detecting user's states can drive interaction and address these limitations. Here, we highlight potential usability and interaction limitations in MR and how physiolo...

Social media platforms use short, highly engaging videos to catch users' attention. While the short-form video feeds popularized by TikTok are rapidly spreading to other platforms, we do not yet understand their impact on cognitive functions. We conducted a between-subjects experiment (N=60) investigating the impact of engaging with TikTok, Twitter...

Dynamic balance is an essential skill for the human upright gait; therefore, regular balance training can improve postural control and reduce the risk of injury. Even slight variations in walking conditions like height or ground conditions can significantly impact walking performance. Virtual reality is used as a helpful tool to simulate such chall...

Adaptive visualization and interfaces pervade our everyday tasks to improve interaction from the point of view of user performance and experience. This approach allows using several user inputs, whether physiological , behavioral, qualitative, or multimodal combinations , to enhance the interaction. Due to the multitude of approaches, we outline th...

Although regular physical activity exposure leads to positive postural balance control (PBC) adaptations, few studies investigated its effects, or the one of inactivity, on PBC in populations of different age groups. Thus, this study investigated the impact of a physically active lifestyle on static and dynamic PBC in young and older adults. Thirty...

A growing number of wearable devices is becoming increasingly non-invasive, readily available, and versatile for measuring different physiological signals. This renders them ideal for inferring the emotional states of their users. Despite the success of wearable devices in recent emotion studies, there are still several challenges to be addressed....

This preregistration template guides researchers who wish to preregister their EEG projects, more specifically studies investigating event-related potentials (ERPs) in the sensor space.

Fatalities with semi-automated vehicles typically occur when users are engaged in non-driving related tasks (NDRTs) that compromise their situational awareness (SA). This work developed a tactile display for on-body notification to support situational awareness, thus enabling users to recognize vehicle automation failures and intervene if necessary...

Virtual reality is increasingly used for tasks such as work and education. Thus, rendering scenarios that do not interfere with such goals and deplete user experience are becoming progressively more relevant. We present a physiologically adaptive system that optimizes the virtual environment based on physiological arousal, i.e., electrodermal activ...

Augmented Reality (AR) embeds virtual content in physical spaces, including virtual agents that are known to exert a social presence on users. Existing design guidelines for AR rarely consider the social implications of an agent's personal space (PS) and that it can impact user behavior and arousal. We report an experiment (N=54) where participants...

In sports, postural balance control has been demonstrated to be one of the limiting factors of performance and a necessary component to achieve any sport technique. Team players (TP) must process and react to multiple external stimuli while executing at the same time the skills of the game. By contrast, endurance athletes (END) must perform the sam...

Background: Remembering to execute delayed intentions (i.e., prospective memory, PM) entails the allocation of internal and external attention. These processes are crucial for rehearsing PM intentions in memory and for monitoring the presence of the PM cue in the environment, respectively. Aim: The study took advantage of the excellent spatial a...

In this study, we present a new application to the study of the N400 related event component applied to the Brain Computer Interfaces (BCI) field. The N400 is classically defined in literature as an index of semantic integration mechanisms and it is sensitive to the difficulty with which the reader integrates the input within the semantic context,...