Andrew L. Kun

University of New Hampshire | UNH · Department of Electrical Engineering

The growing availability of generative AI technologies such as large language models (LLMs) has significant implications for creative work. This paper explores twofold aspects of integrating LLMs into the creative process-the divergence stage of idea generation, and the convergence stage of evaluation and selection of ideas. We devised a collaborat...

Task‐unrelated thought (TUT) occurs frequently in our daily lives and across a range of tasks, but we know little about how this phenomenon arises during and influences the way we communicate. Conversations also provide a novel opportunity to assess the alignment (or divergence) in TUT during dyadic interactions. We conducted a study to determine:...

Teaching pervasive computing courses is challenging during "normal" times,1 let alone during a global pandemic. With the transition to remote learning due to the COVID-19 crisis, we invested much effort into a comprehensive redesign of our tangible and embodied interaction (TEI) course for an online format. In this article, we share our experience...

In this article, we reflect on two virtual workshops that we held during the ACM AutomotiveUI 2020 conference, where we aimed to provide participants an experience similar to in-person meetings, while at the same time making use of digital services for group collaboration. In particular, we elaborate on relevant differences, advantages, and disadva...

Human transportation has a significant impact on carbon dioxide emissions. Recently several industries have fo-cused on producing more sustainable transportation technologies. However, exploiting the emerging benefit of such technologies requires behavioral changes to integrate decisions and behaviors towards sustainable mobility in users' everyday...

Automated vehicles are expected to become a part of the road traffic in the near future. This upcoming change raises concerns on how human road users, e.g., cyclists or pedestrians, would interact with them to ensure safe communication on the road. Previous work focused primarily on the scenario in which a young adult without impairments crosses a...

The gradual implementation of automated driving systems opens a wide range of opportunities for researchers and vehicle designers to transform vehicle interiors into a place for productivity and well-being. Former events held by the organizers have identified a research agenda to transform vehicles into a space for office work. This second edition...

How can technology support workers in our rapidly changing world? How can we help them be productive and creating, and how can we support their overall wellbeing? Our team explores these broad questions for two specific areas: working in future automated vehicles, and working from home. We argue that making progress in these areas will require conv...

What is the future of work and wellbeing? How did the COVID-19 crisis affect this future? What can, and what should, researchers and practitioners in the field of human-computer interaction do, as they develop interfaces for work and wellbeing? These are the questions that we explore in a weekly online series of conversations with HCI experts. In t...

With increasing automation of the driving task, cars' cockpits are transforming towards living spaces rather than pure modalities of transport. The promise of automated vehicles being individual places for relaxation and productivity while on-the-go, however, requires significant research. Not only safety-critical questions, but also issues related...

Will automated driving help or hurt our efforts to remedy climate change? The overall impact of transportation and mobility on the global ecosystem is clear: changes to that system can greatly affect climate outcomes. The design of mobility and automotive systems will influence key factors such as driving style, fuel choice, ride sharing, traffic p...

Multidisciplinary and interdisciplinary education can provide relevant insights to ubiquitous computing and other fields. In this article, we share our experience with multidisciplinary and interdisciplinary teaching in the two-year Artificial Intelligence Research Master’s program at Utrecht University, the Netherlands. In particular, we zoom in o...

Reports on the events and findings from the Dagstuhl Seminar entitled “Ubiquitous Computing Education: Why, What, and How” to explore these questions in more detail.2 The workshop gathered 26 faculty members and one undergraduate student3 to discuss the current state of ubiquitous computing education and to provide ideas for how to improve on our c...

As a third party to both automated and non-automated vehicles , pedestrians are among the most vulnerable participants in traffic. Currently, there is no way for them to communicate their intentions to an automated vehicle (AV). In this work, we explore the interactions between pedestrians and AVs at unmarked crossings. We propose a virtual reality...

In this project we designed an Augmented Reality working space for drivers in a semi-automated vehicle, and evaluated users visual behavior in this space specifically during switching from the AR non-driving task to a Manual-Visual task. The results of this preliminary study show that users do not switch between the two provided tasks immediately a...

This video shows a concept of a future mobile office in a semi-automated vehicle that uses augmented reality. People perform non-driving tasks in current, non-automated vehicles even though that is unsafe. Moreover, even for passengers there is limited space, it is not social, and there can be motion sickness. In future cars, technology such as aug...

Automated vehicles will allow users to engage in non-driving activities related to work and well-being. This workshop will explore a number of questions related to human-computer interaction in vehicles with the ultimate goal of allowing users to be productive in automated vehicles, as well as to engage in activities that successfully increase thei...

With the increasing development of Augmented reality (AR), the number of its purposes and applications in vehicles rises. Augmented reality may help to increase road safety, support more immersive (non-) driving related activities, and finally enhance driving and passenger experience. AR may also be the enabling technology to increase trust and acc...

As vehicles of the future take on more of the driving responsibility and the role of the driver transitions into more of a monitoring capacity, the traditional notions of interruption and attention management needs to be reconsidered for automated vehicles. We argue that the transfer of control between the automated vehicle and the human driver can...

The numerous conversations surrounding the definition of UbiComp, the topics to be covered, and teacher influence on how topics are presented, all helped form a clearer picture of what UbiComp education should be. Some would say that awareness of its own existence is all that a field needs in order to be recognized. This leads the notion that as lo...

In this paper, we present results from a study of users' visual behavior while engaging with tangible and virtual representations of archaeological artifacts. We replicated and extended a recent study that introduced an augmented reality system implemented using HoloLens, for engaging with the artifacts. Our study goes beyond the original study to...

We review the history of human-automation interaction research, assess its current status and identify future directions. We start by reviewing articles that were published on this topic in the International Journal of Human-Computer Studies during the last 50 years. We find that over the years, automated systems have been used more frequently (1)...

Automated driving is one of the most discussed disruptive technologies of this decade. It promises to increase drivers' safety and comfort, improve traffic flow, and lower fuel consumption. This has a significant impact on our everyday life and mobility behavior. Beyond the passengers of the vehicle, it also impacts others, for example by lowering...

Presents reviews of 14 books that can improve and enhance teaching in pervasive computing.

We report on an experiment on the distracting effects of in-car conversations through augmented-reality glasses. Previous research showed that in-car phone conversations can be distracting, but that the distraction might be reduced if the remote caller receives visual information about the driving context. However, what happens if such video sharin...

How can a university lecturer inspire students in pervasive computing? In the interdisciplinary undergraduate program “User Experience Design” (tripartition of computer science, conception and design, and usability) at Technische Hochschule Ingolstadt, we have demonstrated how appropriate didactic concepts generate value in contrast to “purely tran...

In this column, we ask three central questions related to ubiquitous computing education. First, why is specialized ubicomp training needed? Next, what should the goal of such specialized training be? And finally, how should these goals be accomplished pedagogically? We argue that these questions should be answered by a community that supports new...

Augmented reality (AR) has the potential to improve road safety, support more immersive (non-) driving related activities, and finally enhance driving experience. AR may also be the enabling technology to help on the transition towards automated driving. However, augmented reality still faces a number of technical challenges when applied in vehicle...

Augmented reality navigation aids have been investigated in a number of studies, and results are encouraging, especially for large, head-up displays. However, such displays are not commercially available -- in fact they are rare in laboratories as well. In this paper we ask: would drivers be well-served with a navigation aid that overlays AR conten...

This workshop discusses the balance between safety and productivity as automated vehicles turn into 'mobile offices': spaces where non-driving activities are performed during one's daily commute. Technological developments reduce the active role of the human driver that might, nonetheless, require occasional intervention. To what extent are drivers...

The rise of evermore autonomy in vehicles and the expected introduction of self-driving cars have led to a focus on human interactions with such systems from an HCI perspective over the last years. Automotive User Interface researchers have been investigating issues such as transition control procedures, shared control, (over)trust, and overall use...

Technological advances offer new methods of representing physical objects in tangible and virtual forms. This study compares learning outcomes from 61 students as they interact with ancient Egyptian sculptures using three increasingly popular educational technologies: HoloLens AR headset, 3D model viewing website (SketchFab), and plastic extrusion...

Today's vehicles have myriad user interfaces, from those related to the moment-to-moment control of the vehicle, to those that allow the consumption of information and entertainment. The bulk of the research in this domain is related to manual driving. With recent advances in automated vehicles, there is an increased attention to user interactions...

We introduce a Hidden Markov Model framework to formalize the beliefs that humans may have about the mode in which a semi-automated vehicle is operating. Previous research has identified various "levels of automation," which serve to clarify the di↵erent degrees of a vehicle's automation capabilities and expected operator involvement. However, a ve...

We present findings from an empirical study of how groups of eight users collaborate on a decision-making task around an interactive tabletop. To our knowledge, this is the first study to examine co-located collaboration in larger groups (of 8-12 users) seated around a large-scale high-resolution multi-touch horizontal display. Our findings shed li...

The Microsoft HoloLens keeps track of its location and rotation relative to the environment but lacks the ability to capture eye gaze data. We assess a novel method to extend the HoloLens with a head mounted eye-tracker. Using a combination of eye gaze data and head rotation we compared gaze behavior between real and virtual objects. Results indica...

Ubicomp educators can inspire students by giving them technically challenging and socially impactful projects and by exposing them to enriching experiences that involve interacting with professionals from different backgrounds. Here, the authors argue in favor of including international experiences in this already rich education and training space,...

Many automated vehicles are already on our roads, and we can expect that many more will follow soon. Yet, the legal frameworks that govern the deployment and operation of these vehicles are still under development. This paper explores legal issues related to the human-machine interaction for automated vehicles. The paper reviews the current legal l...

It is forecast that augmented reality (AR automotive applications will increase road safety, bring intuitive activities to driving, and finally enhance driving experience. AR technology may also help on the transition towards automated driving. However, many technological challenges need to be addressed before AR applications will hit the mainstrea...

This paper characterizes an urban region using time series of geotagged tweet counts. Time series are constructed for each cell in a rectangular grid. We show how simple, anonymous tweet counts in the cells can be used to classify the cells into urban land use profiles based on the number of residences and businesses. We discover that Twitter activ...

In this paper we use machine learning to evaluate the predictability of taxi pickups in New York City's busiest neighborhoods using data available from the Taxi and Limousine Commission and from Twitter. We found that these pickups can be accurately forecast, and we show which features work well for forecasts, including geotagged Twitter posts in s...

The objective of this tutorial is to provide MobileHCI newcomers to the domain of automotive user interfaces (AutomotiveUI) with an introduction and overview of the field. The tutorial will introduce the specifics and challenges of in-vehicle user interfaces that set this field apart from others. With a clear focus on the integration of mobile devi...

The objective of this course is to provide newcomers to Automotive User Interfaces with an introduction and overview of the field. The course will introduce the specifics and challenges of In-Vehicle User Interfaces that set this field apart from others. We will provide an overview of the specific requirements of AutomotiveUI, discuss the design of...

Many pervasive computing courses don't require a textbook. Instead, a variety of papers are given as assigned reading. Although there are advantages to using papers for reading assignments, there are disadvantages as well. With each course, instructors must curate their own list of important papers, and students don't have the benefit of a well-pla...

The next big change in the automotive domain will be the move towards automated and semiautomated driving. We can expect an increasing level of autonomous driving in the coming years, resulting in new opportunities for the car as an infotainment platform when standard driving tasks will be automated. This change also comes with a number of challeng...

Interactions with in-vehicle electronic devices can interfere with the primary task of driving and increase crash risk. Interactions with in-vehicle interfaces draw upon visual, auditory, psychomotor, and cognitive resources. Researchers often investigate how these resources interfere with performance through the use of different measurement techni...

In this abstract, we present a novel method for exploring the visual behavior of multiple users engaged in a collaborative task around an interactive surface. The proposed method synchronizes input from multiple eye trackers, describes the visual behavior of individual users over time, and identifies joint attention across multiple users. We applie...

Is there a difference in behavior when drivers start driving after parking compared to taking over from an autonomous driving car? In the former, the driving context switch (from static to driving) might be bigger than the latter, where drivers are already in a moving vehicle. This bigger difference might be paired with a decision to stop attending...

In this paper, we present a proof-of-concept approach to estimating mental workload by measuring the user's pupil diameter under various controlled lighting conditions. Knowing the user's mental workload is desirable for many application scenarios, ranging from driving a car, to adaptive workplace setups. Typically, physiological sensors allow infe...

The objective of this course is to provide newcomers to Automotive User Interfaces with an introduction and overview of the field. The course will introduce the specifics and challenges of In-Vehicle User Interfaces that set this field apart from others. We will provide an overview of the specific requirements of AutomotiveUI, discuss the design of...

The field of automotive user interfaces has developed rapidly over the last several years. To date, the field has primarily focused on creating user interfaces that promote safe driving, including when the driver is engaged in a secondary task in addition to operating the vehicle. However, researchers now need to prepare for a major change in the a...

Driving research has recently seen a surge in the collection and use of physiological measurements. This use of physiological data is often part of an attempt to either measure cognitive load or detect affective states. While these methods are becoming more popular it seems that many driving researchers are still unsure of the best methods of data...

Historically detection of workload has been done through the use of subjective measures but new demands in research are driving interests to objective and immediate physiological measures. This paper is a look at some initial data from a study comparing the commonly used measure of heart rate (HR) to that of pupil size (PS), in detecting changes in...

By the nature of their jobs first responders have to interact with in-vehicle devices even as they drive under challenging road conditions. In this paper we assess the state-of-the-art in creating safe in-vehicle user interfaces for first responders, and we propose six research and development priorities for future work in this realm.

We are very pleased to introduce the Proceedings of the Sixth International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI'14). This is the premier forum for user interface (UI) research in the automotive domain. As with previous conferences, the papers and presentations as part of AutomotiveUI'14 addr...

It is well established that driving while interacting with a secondary in-car device, such as a portable music player, is distracting and can lead to a decline in driver safety and performance. One aspect that has not received as much attention though is the extent to which drivers adapt their interactions with an in-car device to the changing dema...

Interactions with in-vehicle electronic devices can interfere with the primary task of driving and increase crash risk. Interactions with in-vehicle interfaces draw upon visual, manipulative and cognitive resources, with this workshop focusing on cognitive resources for which measurement processes are less well known or established. This workshop w...

The Project54 mobile system for law enforcement developed at the University of New Hampshire integrates the control of disparate law enforcement devices such as radar, VHF radio, video, and emergency lights and siren. In addition it provides access to state and national law enforcement databases via wireless data queries. Officers using Project54 a...

Most vehicles only require a key to authenticate the driver. However, with vehicles becoming portals to digital information, many drivers might find this authentication method inadequate. In this paper we explore using tap sequences on the back of the steering wheel to authenticate drivers. Our results indicate that drivers can learn to use an auth...

We explore the feasibility of using pupil diameter to estimate how the cognitive load of the driver changes during a spoken dialogue task with a remote conversant. The conversants play a series of Taboo games, which do not follow a structured turn-taking nor initiative protocol. We contrast the driver's pupil diameter when the remote conversant beg...

Augmented reality (AR) navigation systems are likely to improve the driving experience compared to today's personal navigation devices on the dashboard, as they don't require glances away from the road ahead. As technology is not yet capable to deliver an affordable and seamless HUD AR solution, we explore an inexpensive version of augmentation, wh...

In-car devices with speech user interfaces are proliferating. How can we build these interfaces such that they allow human–computer interactions with multiple devices to overlap in time, but without interfering with the driving task? We suggest that interface design can be inspired by the way people deal with this problem in human–human dialogues a...

This SIG will explore issues related to the design of in-vehicle human-computer interfaces. A modern vehicle's human-computer interface often facilitates the basic operation of the vehicle, but also provides more advanced features, such as assistive cruise control and lane keeping. Furthermore, today's drivers and passengers frequently use brought-...

A key aspect of the 2012 AutomotiveUI conference was trying to understand what information drivers use in vehicles. In particular, the seven podium sessions focused on driver distraction, models, visual and audio modalities, driver-vehicle interfaces, multimodal interactions, navigation, and workload/demand.

In a driving simulator study, we explore the feasibility of using pupil diameter to estimate how the cognitive load of the driver changes during a spoken dialogue with a remote conversant. We confirm that it is feasible to use pupil diameter to differentiate between parts of the dialogue that increase the cognitive load of the driver, and those tha...

In driving simulator studies pupil diameter is often employed as a physiological measure of cognitive load. However, pupil size is primarily influenced by the pupillary light reflex (PLR). In this paper, we explore the influence of the size and luminance of visual targets on the PLR. Our results indicate that even for small targets (angular radius...

Automotive navigation systems are becoming ubiquitous as driver assistance systems. Vendors continuously aim to enhance route guidance by adding new features to their systems. However, we found in an analysis of current navigation systems that many share ...

New technologies have made video calling in vehicles possible. Results from a driving simulator experiment indicate that video calling reduces visual attention on the road. While in some situations drivers would refrain from engaging in this activity, our results should serve as a warning to interface designers, lawmakers, transportation officials,...

Pupil diameter is an important measure of cognitive load. However, pupil diameter is also influenced by the amount of light reaching the retina. In this study we explore the interaction between these two effects in a simulated driving environment. Our results indicate that it is possible to separate the effects of illumination and visual cognitive...

Today's in-car information systems are undergoing an evolution towards realistic visualization as well as to real-time telematics services. In a road study with 31 participants we explored the communication of safety information to the driver. We compared three presentation styles: audio-only, audiovisual with a conventional map, and audiovisual wi...

This workshop will address two emerging fields within the HCI community: user experience (UX) and the automotive context. It will bring HCI experts together to discuss UX factors for the specific characteristics of car interiors and automotive user interfaces. It targets the development of a better view of UX within the whole car (driver, front sea...

Prior research has shown that when drivers look away from the road to view a personal navigation device (PND), driving performance is affected. To keep visual attention on the road, an augmented reality (AR) PND using a heads-up display could overlay a navigation route. In this paper, we compare the AR PND, a technology that does not currently exis...

In this article we focus on human–human multi-tasking dialogues, in which pairs of conversants, using speech, work on an ongoing task while occasionally completing real-time tasks. The ongoing task is a poker game in which conversants need to assemble a poker hand, and the real-time task is a picture game in which conversants need to find out wheth...

Pupil diameter can be used as a physiological measure of cognitive load in driving simulator studies. However, pupil size depends on both cognitive load and lighting conditions. In order to accurately estimate cognitive load these two effects must be separated. In our study we introduce illumination only, cognitive only and combined tasks. Based on...

We report on the design of spoken tasks for a study that explored how people manage spoken multi-threaded dialogues while one of the conversants is operating a simulated vehicle. Based on a series of preliminary studies we propose a set of considerations that researchers should take into account when designing such tasks. Using these considerations...

With the proliferation of pervasive devices and the increase in their processing capabilities, client-side speech processing has been emerging as a viable alternative. The SiMPE workshop series started in 2006 [5] with the goal of enabling speech processing on mobile and embedded devices to meet the challenges of pervasive environments (such as noi...

Cars have become complex interactive systems. Mechanical controls and electrical systems are transformed to the digital realm. It is common that drivers operate a vehicle and, at the same time, interact with a variety of devices and applications. Texting while driving, looking up an address for the navigation system, and taking a phone call are jus...

We report on the results of a study in which pairs of subjects were involved in spoken dialogues and one of the subjects also operat- ed a simulated vehicle. We estimated the driver's cognitive load based on pupil size measurements from a remote eye tracker. We compared the cognitive load estimates based on the physiological pupillometric data and...