Enrico Rukzio

Ulm University | UULM · Institute of Media Informatics

Projectors are pervasive as infrastructure devices for large displays but are now also becoming available in small form factors that afford mobile personal use. This article surveys the interaction space of "projectors on the move" and reviews input and output concepts, underlying sensing challenges, and emerging applications.

Smartphones provide large amounts of personal data, functionalities, and apps and make a substantial part of our daily communication. But during phone calls the phone cannot be used much beyond voice communication and does not offer support for synchronous collaboration. This is owed to the fact that first, despite the availability of alternatives,...

Touchscreens became the dominant input device for smartphones. Users' touch behaviour has been widely studied in lab studies with a relative low number of participants. In contrast, we published a game in the Android Market that records the touch behaviour when executing a controlled task to collect large amounts of touch events. Players' task is t...

Automated vehicles are expected to communicate with vulnerable road users. In two longitudinal studies, we investigated the impact of external Human-Machine Interfaces (eHMI) on pedestrian safety and behavior when interacting with automated vehicles. Utilizing LED strips for communication, these studies probed various factors, including mixed traff...

Automated Urban Air Mobility (UAM) is expected to improve passenger transportation but raises concerns about passenger trust and its impact on residents. We address these issues through three online studies using 360-degree videos. The study on adverse lighting and weather conditions (N=31) shows that bounding box visualizations of other air taxis...

Thermal attributes in the environment impact well-being, but their inclusion in standard well-being monitoring is challenging due to complex measurement requirements. Industry standards like the Predicted Mean Vote (PMV) index need numerous measures and specialized setups, making large-scale applications impractical. This study investigates predict...

As vehicle automation advances to SAE Levels 3 to 5, transitioning driving control from human to system, ensuring automated vehicles (AVs) align with user preferences becomes a challenge. Natural interaction emerges as a common goal, offering ways to convey user interests in a user-friendly manner. However, technical, legal, or design constraints m...

As vehicle automation progresses, with SAE levels 3 to 5 introducing varying degrees of control transfer from driver to vehicle, a key challenge emerges: aligning driver interests with the automated vehicle's (AV) operational goals. Despite technical feasibility, drivers' tendencies to intervene due to distrust in or dissatisfaction with AVs necess...

Thermal comfort inside buildings is a well-studied field where human judgment for thermal comfort is collected and may be used for automatic thermal comfort estimation. However, indoor scenarios are rather static in terms of thermal state changes and, thus, cannot be applied to dynamic conditions, e.g., inside a vehicle. In this work, we present ou...

Rising diversity through novel forms of mobility and increasing connectivity through intelligent systems and wireless connection is leading to a complex traffic environment. However, traditional automotive interface research often focuses on the interaction between vehicle and driver, passenger, or pedestrian, not capturing the interconnected relat...

User acceptance is essential for successfully introducing automated vehicles (AVs). Understanding the technology is necessary to overcome skepticism and achieve acceptance. This could be achieved by visualizing (uncertainties of) AV's internal processes, including situation perception, prediction, and trajectory planning. At the same time, relevant...

Highly Automated Vehicles offer a new level of independence to people who are blind or visually impaired. However, due to their limited vision, gaining knowledge of the surrounding traffic can be challenging. To address this issue, we conducted an interactive, participatory workshop (N=4) to develop an auditory interface and OnBoard - a tactile int...

As automated vehicles become more widespread but lack a driver to communicate in uncertain situations, external communication, for example, via LEDs or displays, is evaluated. However, the concepts are mostly evaluated in simple scenarios, such as one person trying to cross in front of one automated vehicle. The traditional empirical approach fails...

Energy-saving features (ESFs) represent a simple way to reduce the resource consumption of home appliances (HAs), yet they remain under-utilized. While prior research focused on increasing the use of ESFs through behavior change interventions, there is currently no clarity on the barriers that restrict their utilization in the first place. To bridg...

Novel display technologies, such as lightfield displays, have become increasingly available. In the automotive domain, these are already in use or are to be used in the future. However, their effect on the user is yet to be explored. Therefore, we conducted a within-subject study (N=15) comparing a baseline visualization of information about automa...

Automated vehicles are expected to improve safety, mobility, and inclusion. User acceptance is required for the successful introduction of this technology. One essential prerequisite for acceptance is appropriately trusting the vehicle's capabilities. System transparency via visualizing internal information could calibrate this trust by enabling th...

3D-printers enable end-users to design and fabricate unique physical artifacts but maintain an increased entry barrier and friction. End users must design tangible artifacts through intangible media away from the main problem space (ex-situ) and transfer spatial requirements to an abstract software environment. To allow users to evaluate dimensions...

Today's social media (SM) platforms are toolkits consisting of features with different use cases, some strongly related to habitual and regretful use. Especially Infinite Scrolling (IS) has been reported to make users feel like they are being caught in a loop, regretfully elongating SM sessions. We investigated and defined this loop while unveiling...

In highly automated vehicles, passengers can engage in non-driving-related activities. Additionally, the technical advancement allows for novel interaction possibilities such as voice, gesture, gaze, touch, or multimodal interaction, both to refer to in-vehicle and outside objects (e.g., thermostat or restaurant). This interaction can be characteri...

This position paper discusses the negative effects of excessive smartphone usage on mental health and well-being. Despite efforts to limit smartphone usage, users become desensitized to reminders and limitations. The paper proposes the use of Push & Pull Factors to contextualize intervention strategies promoting digital well-being. Further, alterna...

Automated vehicles will alter traffic fundamentally. While users can engage in non-driving-related tasks such as reading or even sleeping, the possibility to interact with other road users such as pedestrians via, for example, eye contact vanishes. Therefore, external communication of automated vehicles is currently researched with various concepts...

Automated Urban Air Mobility will enhance passenger transportation in metropolitan areas in the near future. Potential passengers, however, have little knowledge about this mobility form. Therefore, there could be concerns about safety and low trust. As trajectories are essential information to address these concerns, we evaluated seven path visual...

User acceptance is essential for successfully introducing automated vehicles (AVs). Understanding the technology is necessary for its acceptance. This could be achieved by visualizing (uncertainties of) AV's internal processes, including situation perception, prediction, and maneuver planning. However, imposing scenarios in user studies may be unfi...

State recognition in well-known and customizable environments such as vehicles enables novel insights into users and potentially their intentions. Besides safety-relevant insights into, for example, fatigue, user experience-related assessments become increasingly relevant. As thermal comfort is vital for overall comfort, we introduce a dataset for...

Automotive user interfaces constantly change due to increasing automation, novel features, additional applications, and user demands. While in-vehicle interaction can utilize numerous promising modalities, no existing overview includes an extensive set of human sensors and actuators and interaction locations throughout the vehicle interior. We cond...

The inclusion of in-vehicle sensors and increased intention and state recognition capabilities enable implicit in-vehicle interaction. Starting from a systematic literature review (SLR) on implicit in-vehicle interaction, which resulted in 82 publications, we investigated state and intention recognition methods based on (1) their used modalities, (...

The highest CO2 quota per person is personal transport. An ecological driving style (eco-driving) could drastically reduce it's emissions. Current interventions focus mainly on training, which benefits are mostly short-term, and individual feedback, which needs commitment by setting (individual) goals. We present the concept of displaying not only...

Educational apps support learning, but handwriting training is still based on analog pen- and paper. However, training handwriting with apps can negatively affect graphomotor handwriting skills due to the different haptic feedback of the tablet, stylus, or finger compared to pen and paper. With SpARklingPaper, we are the first to combine the genuin...

Automated vehicles should improve both traffic safety and user experience. While novel behavior patterns such as platooning become feasible to reduce fuel usage, such time-and fuel-reducing behavior at intersections can be perceived as unsafe and possibly disconcert users. Therefore, we designed and implemented nine feedback strategies for a simula...

Automated vehicles will change the interaction with the user drastically. While freeing the user of the driving task for most of the journey, the "final 100 meters problem", directing the vehicle to the final parking spot, could require human intervention. Therefore, we present a classification of interaction concepts for automated vehicles based o...

Automated vehicles are expected to substitute or even improve driver-driver communication, for example, via LED strips or displays. Numerous situations exist where ambiguities have to be resolved via gestures or implicit communication (i.e., movement). An already demanding situation is the unsignalized four-way intersection. Additionally, Vehicle-T...

Infrastructure-mounted sensors that monitor roads can provide essential information for manual drivers and automated vehicles, e.g., positions of other vehicles occluded by buildings. However, human drivers and passengers have to trust and accept their use. This raises the question of how trust can be increased in such a scenario. One important fac...

Investigating trust, acceptance, and attitudes towards automated driving is often investigated in simulator experiments. Therefore, behavioral validity is a crucial aspect of automated driving studies. However, static simulators have reduced behavioral validity because of their inherent safe environment. We propose VAMPIRE (VR automated movement pl...

Digital eye strain (DES), caused by prolonged exposure to digital screens, stresses the visual system and negatively affects users’ well-being and productivity. While DES is well-studied in computer displays, its impact on users of virtual reality (VR) head-mounted displays (HMDs) is largely unexplored—despite that some of their key properties (e.g...

Virtual reality (VR) environments offer new opportunities for mastering complex procedures (e.g. manipulating 3D objects). Novices might be confronted with challenges that they can overcome with the help of an expert. For example, expert strategy instruction might facilitate the performance of 3D object manipulations. Moreover, the available intera...

Automated vehicles are expected to communicate with pedestrians at least during the introductory phase, for example, via LED strips, displays, or loudspeakers. While these are added to minimize confusion and increase trust, the human passenger within the vehicle could perform motions that a pedestrian could misinterpret as opposing the vehicle’s co...

Automotive user interfaces constantly change due to increasing automation, novel features, additional applications, and user demands. While in-vehicle interaction can utilize numerous promising modalities, no existing overview includes an extensive set of human sensors and actuators and interaction locations throughout the vehicle interior. We cond...

The successful introduction of automated vehicles (AVs) depends on the user's acceptance. To gain acceptance, the intended user must trust the technology, which itself relies on an appropriate understanding. Visualizing internal processes could aid in this. For example, the functional hierarchy of autonomous vehicles distinguishes between perceptio...

Interacting with a group of people requires to direct the attention of the whole group, thus requires feedback about the crowd’s attention. In face-to-face interactions, head and eye movements serve as indicator for crowd attention. However, when interacting online, such indicators are not available. To substitute this information, gaze visualizati...

Webcam-based eye-tracking promises easy and quick data collection without the need for specific or additional eye-tracking hardware. This makes it especially attractive for educational research, in particular for modern formats, such as MOOCs. However, in order to fulfill its promises, webcam-based eye tracking has to overcome several challenges, m...

Large high-resolution displays (LHRDs) provide an enabling technology to achieve immersive, isometrically registered, virtual environments. It has been shown that LHRDs allow better size judgments, higher collaboration performance, and shorter task completion times. This paper presents novel insights into human size perception using large-scale flo...

Automated vehicles are expected to require some form of communication (e.g., via LED strip or display) with vulnerable road users such as pedestrians. However, the passenger inside the automated vehicle could perform gestures or motions which could potentially be interpreted by the pedestrian as contradictory to the outside communication of the car...

Personal fabrication is made more accessible through repositories like Thingiverse, as they replace modeling with retrieval. However, they require users to translate spatial requirements to keywords, which paints an incomplete picture of physical artifacts: proportions or morphology are non-trivially encoded through text only. We explore a vision o...

Automated trucks for long-distance journeys seem within reach. With such automation, no human driver could be available. However, the last mile of the delivery is likely to involve humans. Therefore, either a human driver should still be present, or construction site workers must interact with the automated truck. While automated trucks capable of...

The automation of the driving task affects both the primary driving task and the automotive user interfaces. The liberation of user interface space and cognitive load on the driver allows for new ways to think about driving. Related work showed that activities such as sleeping, watching TV, or working will become more prevalent in the future. Howev...

Autonomous vehicles provide new input modalities to improve interaction with in-vehicle information systems. However, due to the road and driving conditions, the user input can be perturbed, resulting in reduced interaction quality. One challenge is assessing the vehicle motion effects on the interaction without an expensive high-fidelity simulator...

Personal fabrication empowers users to create objects increasingly easier and faster. This continuous decrease in effort evokes a speculative scenario of Ephemeral Fabrication (EF), enabled and amplified by emerging paradigms of mobile, wearable, or even body-integrated fabrication. EF yields fast, temporary, in-situ solutions for everyday problems...

Players can get stuck in video games, which impedes their process to their goal and results in unfavorable outcomes like negative emotions, impediments of flow, and obstacles for learning. Currently, it is not easily possible to assess if a player is stuck, as no widely accepted definition of "being stuck" in games exists. We conducted 13 expert in...

The advance of automated driving allows the users to engage in non-driving related activities such as sleeping. However, until full automation is reached, the user may have to interact with the vehicle, for example, in planned take-overs, which requires the user to be awake and conscious. To evaluate auditory and visual awakening concepts (alarm, f...

Passengers of automated vehicles will likely engage in non-driving related activities like reading and, therefore, be disengaged from the driving task. However, especially in critical situations such as unexpected pedestrian crossings, it can be assumed that passengers request information about the vehicle's intention and an explanation. Some conce...