About
75
Publications
18,273
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
502
Citations
Introduction
Additional affiliations
April 2021 - December 2021
May 2019 - March 2021
Publications
Publications (75)
Procrastination, the voluntary delay of tasks despite potential negative consequences, has prompted numerous time and task management interventions in the HCI community. While these interventions have shown promise in addressing specific behaviors, psychological theories suggest that learning about procrastination itself may help individuals develo...
Classroom debates are a unique form of collaborative learning characterized by fast-paced, high-intensity interactions that foster critical thinking and teamwork. Despite the recognized importance of debates, the role of AI tools, particularly LLM-based systems, in supporting this dynamic learning environment has been under-explored in HCI. This st...
AI-generated media products are increasingly prevalent in the news industry, yet their impacts on audience perception remain underexplored. Traditional media often employs negative framing to capture attention and capitalize on news consumption, and without oversight, AI-generated news could reinforce this trend. This study examines how different f...
Exploring moral dilemmas allows individuals to navigate moral complexity, where a reversal in decision certainty, shifting toward the opposite of one's initial choice, could reflect open-mindedness and less rigidity. This study probes how nonverbal emotional cues from conversational agents could influence decision certainty in moral dilemmas. While...
Children with autism spectrum disorder (ASD) have social-emotional deficits that lead to difficulties in recognizing emotions as well as understanding and responding to social interactions. This study presents EMooly, a tablet game that actively involves caregivers and leverages augmented reality (AR) and generative AI (GenAI) to enhance social-emo...
Surface sensing is widely employed in health diagnostics, manufacturing and safety monitoring. Advances in mobile sensing affords this potential for context awareness in mobile computing, typically with a single sensing modality. Emerging multimodal large-scale language models offer new opportunities. We propose MultiSurf-GPT, which utilizes the ad...
Despite being prominent and ubiquitous, text message-based communication is limited in nonverbally conveying emotions. Besides emoticons or stickers, messaging users continue seeking richer options for affective communication. Recent research explored using chat balloons' shape and color to communicate emotional states. However, little work explore...
The advent of Generative AI and Large Language Models has not only enhanced the intelligence of interactive applications but also catalyzed the formation of communities passionate about customizing these AI capabilities. FlowGPT, an emerging platform for sharing AI prompts and use cases, exemplifies this trend, attracting many creators who develop...
Creating promotional posts on social platforms enables everyday users to disseminate their creative outcomes, engage in community exchanges, or generate additional income from micro-businesses. However, creating eye-catching posts combining both original, appealing images and articulate, effective captions can be rather challenging and time-consumi...
In children's collaborative learning, effective peer conversationscan significantly enhance the quality of children's collaborative interactions. The integration of Large Language Model (LLM) agents into this setting explores their novel role as peers, assessing im.pacts as team moderators and participants. We invited two groups of participants to...
Teacher-student interaction (TSI) is essential for learning efficiency and harmonious teacher-student interpersonal relationships. However, studies on TSI support tools often focus on teacher needs while neglecting student needs and autonomy. To enhance both lecturer competence in delivering interpersonal interaction and student autonomy in TSI, we...
Art therapy has been an essential form of psychotherapy to facilitate psychological well-being, which has been promoted and transformed by recent technological advances into digital art therapy. However, the potential of digital technologies has not been fully leveraged; especially, applying AI technologies in digital art therapy is still under-exp...
We introduce the preliminary exploration of AniBalloons, a novel form of chat balloon animations aimed at enriching nonverbal affective expression in text-based communications. AniBalloons were designed using extracted motion patterns from affective animations and mapped to six commonly communicated emotions. An evaluation study with 40 participant...
Teacher-student interaction (TSI) is essential for learning efficiency and harmonious teacher-student interpersonal relationships. However, studies on TSI support tools often focus on teacher needs while neglecting student needs and autonomy. To enhance both lecturer competence in delivering interpersonal interaction and student autonomy in TSI, we...
Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that affects how children communicate and relate to other people and the world around them. Emerging studies have shown that neurofeedback training (NFT) games are an effective and playful intervention to enhance social and attentional capabilities for autistic children. However, NFT i...
When practitioners are in the midst of their busy day-to-day work—such as teachers facilitating learners in the classroom or nurses caring for patients in the hospital—they face complex social or material environments and intensive, intertwined activities. Yet unprecedentedly, these practitioners also need to incorporate technologies, as increasing...
A rising number of HCI scholars have begun to use materiality as a starting point for exploring the design’s potential and restrictions. Despite the theoretical flourishing, the practical design process and instruction for beginner practitioners are still in scarcity. We leveraged the pictorial format to illustrate our crafting process of Puffy, a...
A rising number of HCI scholars have begun to use materiality as a starting point for exploring the design's potential and restrictions. Despite the theoretical flourishing, the practical design process and instruction for beginner practitioners are still in scarcity. We leveraged the pictorial format to illustrate our crafting process of Puffy, a...
The creation process of design fiction is going participatory and inclusive with non experts. Recognizing the potential of artificial intelligence in creativity support, we explore the use of AI assistance in creating design fiction. This investigation is based on a workshop on future work in 2040 with Chinese youth. We look into fiction quality, p...
The original article was published with incorrect affiliation for Prof Matthias Rauterberg. The correct affiliation is Department of Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands.
Emoticons are indispensable in online communications. With users' growing needs for more customized and expressive emoticons, recent messaging applications begin to support (limited) multi-modal emoticons: e.g., enhancing emoticons with animations or vibrotactile feedback. However, little empirical knowledge has been accumulated concerning how peop...
Social interactions significantly impact the quality of life for people with special needs (e.g., older adults with dementia and children with autism). They may suffer loneliness and social isolation more often than people without disabilities. There is a growing demand for technologies to satisfy the social needs of such user groups. However, eval...
Purpose The development of assistive technologies that support people in social interactions has attracted increased attention in HCI. This paper presents a systematic review of studies of Socially Assistive Systems targeted at older adults and people with disabilities. The purpose is threefold: (1) Characterizing related assistive systems with a s...
Almost all older people with dementia have progressive communication difficulties, which lead to increased social isolation and negative emotions. Thus, providing communication assistance for them is essential. This paper explores the feasibility of using social robots to assist older people with dementia in their face-to-face communication with ot...
Research into the role of emotions in Design-Based Learning (DBL) is growing, but little attention has been paid to the regulation of students’ emotional resources to support their DBL experiences. Here we investigate the social sharing of emotions in the DBL context and explore how such behavior affects students’ DBL experiences that might help em...
Neurofeedback games are an effective and playful approach to enhance certain social and attentional capabilities in children with autism, which are promising to become widely accessible along with the commercialization of mobile EEG modules. However, little industry-based experiences are shared, regarding how to better design neurofeedback games to...
In the experience economy, many companies invest tremendous resources and budgets in understanding customers’ experiences and use the insights to design products or services that can make customers happy and satisfied. However, there is still a lack of further exploration of the details that influence consumers’ experience of the journey, one impor...
Current research on explainable AI (XAI) is primarily aimed at expert users (data scientists or AI developers). However, there is an increasing emphasis on making AI more understandable to non-experts who are expected to use AI techniques but have limited knowledge about AI. We propose a mobile application to help non-experts understand convolution...
Teachers in higher education are tasked with the demanding job of providing support tailored to each individual student’s need. To provide tailored support, teachers need to accurately monitor students’ activities and decide on appropriate support interventions. Learning analytics applications have the potential to aid teachers to maintain an overv...
Current research on Explainable AI (XAI) heavily targets on expert users (data scientists or AI developers). However, increasing importance has been argued for making AI more understandable to nonexperts, who are expected to leverage AI techniques, but have limited knowledge about AI. We present a mobile application to support nonexperts to interac...
Effective teamwork is critical to improve patient outcomes in healthcare. However, achieving this capabilityrequires that pre-service nurses develop the spatial abilities they will require in their clinical placements, suchas: learning when to remain close to the patient and to other team members; positioning themselves correctlyat the right time;...
Slow breathing guiding applications increasingly emerge, showing promise for helping knowledge workers to better cope with workaday stress. However, standard breathing guidance is non-interactive, with rigid paces. Despite their effects being proved, they could cause respiratory fatigue, or lack of training motivation, especially for novice users....
Social signals (e.g., facial expression, gestures) are important in social interactions. Most of them are visual cues, which are hardly accessible for visually impaired people, causing difficulties in their daily living. In human–computer interaction (HCI), assistive systems for social interactions are getting increasing attention due to related te...
Sitting in front of computers has become a major part of our workaday routines, challenging us in maintaining active and healthy lifestyles. This challenge becomes even more salient during this worldwide work-from-home period due to COVID-19. While a wide variety of existing interactive systems have been developed to facilitate health tracking and...
Sitting in front of computers has become a major part of our workaday routines, challenging us in maintaining active and healthy lifestyles. This challenge becomes even more salient during this worldwide work-from-home period due to COVID-19. While a wide variety of existing interactive systems have been developed to facilitate health tracking and...
Teachers' response to the real-time needs of diverse learners in the classroom is important for each learner's success. Teachers who give differentiated instruction (DI) provide pertinent support to each student and acknowledge their differences in learning style and pace. However, due to the already complex and intensive routines in classrooms, it...
In the past two years, an emerging body of HCI work has been focused on classroom proxemics - how teachers divide time and attention over students in the different regions of the classroom. Tracking and visualizing this implicit yet relevant dimension of teaching can benefit both research and teacher professionalization. Prior work has proved the v...
Recently, the HCI community has seen increased interest in the design of teaching augmentation (TA): tools that extend and complement teachers' pedagogical abilities during ongoing classroom activities. Examples of TA systems are emerging across multiple disciplines, taking various forms: e.g., ambient displays, wearables, or learning analytics das...
Addressing students by their names helps a teacher to start building rapport with students and thus facilitate their classroom participation. However, this basic yet effective skill has become rather challenging for university lecturers (especially in Asian universities), who have to handle large-sized (sometimes exceeding 100) groups in their dail...
This paper presents a novel approach to monitor office workers’ behavioral patterns and heart rate variability. We integrated an EMFi sensor into a chair to measure the pressure changes caused by a user’s body movements and heartbeat. Then, we employed machine learning methods to develop a classification model through which different work behaviors...
This pictorial proposes an alternative mode of interaction between nurses and clinical alarm syste ms and shows how three concepts, developed to interact through the end user's periphery of attention, can be applied in a clinical setting to improve the workflow of nurses and wellbeing of patients.
Through the integration of technology-enhanced learning (TEL) in the classrooms, there is an increase in Virtual Learning Environment-supported classes in secondary schools, which brings unintentional complexities in terms of monitoring for teachers [25]. To support secondary school teachers during VLE-supported lessons, a peripheral data visualisa...
Reflecting on their performance during classroom-teaching is an important competence for teachers. Such reflection-in-action (RiA) enables them to optimize teaching on the spot. But RiA is also challenging, demanding extra thinking in teachers' already intensive routines. Little is known on how HCI systems can facilitate teachers' RiA during classr...
Reflection-in-action (RiA) refers to teachers' reflections on their teaching performance during busy classroom routines. RiA is a demanding competence for teachers, but little has been known about how HCI systems could support teachers' RiA during their busy and intensive teaching. To bridge this gap, we design and evaluate an ambient information s...
This paper presents an efficient and direct method to transform emotional signals into tactile signals. The tactile expressions were implemented with a triangle wave oscillator from an open-source library. To gather user experiences and design implications, one study was carried out to evaluate whether the tactile expressions could enhance the emot...
As necessary for creating a learner-centered environment, nowadays teachers are expected to be more mindful about their proximity distribution: how to spend time in different locations of the classroom with individual learners. However feedback on this is only given to teachers by experts after classroom observation. In this paper we present the de...
Secondary school teachers have complex, intensive and dynamic routines in their classrooms, which makes their attentional resources limited for human-computer interaction. Leveraging principles of peripheral interaction can reduce attention demanded by technologies and interactions could blend more seamlessly into the everyday routine. We present t...
Secondary school teachers have quite busy and complex routines in their classrooms. However, present classroom technologies usually require focused attention from teachers while being interacted with, which restricts their use in teachers’ daily routines. Peripheral interaction is a human-computer interaction style that aims to enable interaction t...