Nadia Bianchi-Berthouze

Nadia Bianchi-Berthouze
University College London | UCL · UCL Interaction Centre

PhD

About

329
Publications
80,711
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
8,076
Citations
Additional affiliations
February 2006 - present
University College London
Position
  • Professor (Full)
Description
  • Reader in Affective Computing working on Affective body expression recognition, Affective touch, Full-body games technology, Technology for physical rehabilitation, Chronic Pain, Subjective interpretation of images, Affective Computing, Kansei Engineering

Publications

Publications (329)
Article
Full-text available
Touch offers important non-verbal possibilities for socioaffective communication. Yet most digital communications lack capabilities regarding exchanging affective tactile messages (tactile emoticons). Additionally, previous studies on tactile emoticons have not capitalised on knowledge about the affective effects of certain mechanoreceptors in the...
Article
Social media (SM) breaks from studying can either support students' wellbeing and performance by acting as a recovery behaviour or subvert it by acting as a procrastination behaviour. It is currently unclear which influences lead an SM break to be a positive recovery vs. negative procrastination behaviour. A behavioural and emotion regulation (ER)...
Article
The 9TH AAAC Conference on Affective Computing and Intelligent Interaction 2021 was held in a virtual format in the fall of 2021. It was technically co-sponsored by the IEEE Computer Society and featured the recent work on Affective Computing. The six best papers from this conference were selected by the technical program chairs. They were invited...
Article
The rise of fast fashion as a feature of post-industrial societies has distanced people from many of the habitual practices associated with caring for and valuing clothes. This includes both acquiring and applying the skills to make and mend clothes and understanding fibres and fabrics to develop deeper connections to materials. The principles advo...
Article
Wearables integrating movement sonification can support body-perception changes and relatedly physical activity; yet, we lack design principles for such sonifications. Through two mixed-methods studies, we investigate sound pitch and movement direction interaction effects on self-perception during squats exercises. We measured effects on body-perce...
Conference Paper
Full-text available
The fashion industry's negative impact and overcon-sumption require urgent action to improve and reduce fashion consumption. Tactile gesture plays a vital role in understanding, selecting, and feeling attached to clothes. In this paper, we introduce the FabricTouch II dataset with multimodal infromation, which focuses on fabric assessment touch ges...
Article
Full-text available
Technology offers possibilities for quantification of behaviors and physiological changes of relevance to chronic pain, using wearable sensors and devices suitable for data collection in daily life contexts. We conducted a scoping review of wearable and passive sensor technologies that sample data of psychological interest in chronic pain, includin...
Article
Chronic pain is a prevalent condition where fear of movement and pain interfere with everyday functioning. Yet, there is no open body movement dataset for people with chronic pain in everyday settings. Our EmoPain@Home dataset addresses this with capture from 18 people with and without chronic pain in their homes, while they performed their routine...
Article
Background Among the adaptations of movement consistently associated with disability in chronic pain, guarding is common. Based on previous work, we sought to understand better the constituents of guarding; we also used the concept of flow to explore the description of un/naturalness that emerged from physiotherapists' descriptions of movement in c...
Article
Given the importance of affective touch in human interactions, technology designers are increasingly attempting to bring this modality to the core of interactive technology. Advances in haptics and touch-sensing technology have been critical to fostering interest in this area. In this survey, we review how affective touch is investigated to enhance...
Poster
Body illusions could serve as valuable tools to identify individuals who are most likely to benefit from therapies due to their heightened body-image flexibility. However, little is known about the association between body-image flexibility and key psychological factors related to eating disorder (ED) symptomatology such as hypersensitivity and def...
Poster
Individuals with subthreshold symptoms of Eating Disorders (ED) present problems in integrating auditory signals related to body weight into their body. However, it remains unclear whether these impairments are specific to auditory bodily signals or if they extend to other auditory signals. Here we investigated the "auditory Pinocchio illusion," wh...
Preprint
Full-text available
Touch offers important non-verbal possibilities for socioaffective communication. Yet most digital communications lack capabilities regarding exchanging affective tactile messages (tactile emoticons). Additionally, previous studies on tactile emoticons have not capitalised on knowledge about the affective effects of certain mechanoreceptors in the...
Poster
Individuals with subthreshold Eating Disorder (ED) symptomatology and anorexia nervosa experience difficulties in integrating auditory-signals related to body weight into their body perception. However, it is unclear whether these impairments are specific to auditory bodily signals or extend to any auditory signals. We used the "auditory Pinocchio...
Chapter
The annotation of domain experts is important for some medical applications where the objective ground truth is ambiguous to define, e.g., the rehabilitation for some chronic diseases, and the prescreening of some musculoskeletal abnormalities without further medical examinations. However, improper uses of the annotations may hinder developing reli...
Article
There is a growing body of studies on applying deep learning to biometrics analysis. Certain circumstances, however, could impair the objective measures and accuracy of the proposed biometric data analysis methods. For instance, people with chronic pain (CP) unconsciously adapt specific body movements to protect themselves from injury or additional...
Article
Full-text available
Introduction Virtual environments are increasingly being used for training. It is not fully understood what elements of virtual environments have the most impact and how the virtual training is integrated by the brain on the sought-after skill transference to the real environment. In virtual training, we analyzed how the task level of abstraction m...
Article
Full-text available
Background Bodily illusions can be used to investigate the experience of being in a body by manipulating the underlying processes of multisensory integration. Research suggests that people with eating disorders (EDs) may have impairments in visual, interoceptive, proprioceptive, and tactile bodily perception. Furthermore, people with EDs also show...
Article
Full-text available
The use of multiple raters to label datasets is an established practice in affective computing. The principal goal is to reduce unwanted subjective bias in the labelling process. Unfortunately, this leads to the key problem of identifying a ground truth for training the affect recognition system. This problem becomes more relevant in a sparsely-cro...
Article
Self-supervised learning has shown value for uncovering informative movement features for human activity recognition. However, there has been minimal exploration of this approach for affect recognition where availability of large labelled datasets is particularly limited. In this paper, we propose a P-STEMR (Parallel Space-Time Encoding Movement Re...
Article
Full-text available
Previous studies suggest a stronger influence of visual signals on body image in individuals with eating disorders (EDs) than healthy controls; however, the influence of other exteroceptive sensory signals remains unclear. Here we used an illusion relying on auditory (exteroceptive) signals to manipulate body size/weight perceptions and investigate...
Conference Paper
While there is growing interest in developing tech-nology to support pain assessment, pain-related self-management, and healthcare personalisation, there are currently no datasets on nonverbal pain behaviour in the context of functional activities. To address this gap, we introduce the EmoPain(at)Home dataset which consists of motion capture data a...
Conference Paper
Chronic pain is a prevalent condition that affects everyday life of people around the world. Protective behaviors (strategies that are naturally but unhelpfully adopted by people with chronic pain to cope with fear of pain in executing harmless everyday movements) can lead to further disability over time if not recognized and addressed appropriatel...
Preprint
Reliable segmentation of thermal facial images in unconstrained settings such as thermal ambience and occlusions is challenging as facial features lack salience. Limited availability of datasets from such settings further makes it difficult to train segmentation networks. To address the challenge, we propose Self-Adversarial Multi-scale Contrastive...
Preprint
Background Experimental research based on bodily illusions suggests that people with eating disorders (EDs) might have impairments in visual, interoceptive, proprioceptive, and tactile perception, potentially underpinning altered multisensory integration processes. Along this line, research indicates that people with EDs show abnormalities in integ...
Article
Full-text available
Background: Many technological interventions designed to promote physical activity (PA) have limited efficacy and appear to lack important factors that could increase engagement. This may be due to a discrepancy between research conducted in this space, and software designers' and developers' use of this research to inform new digital applications...
Article
Movement dataset reviews exist but are limited in coverage, both in terms of size and research discipline. While topic-specific reviews clearly have their merit, it is critical to have a comprehensive overview based on a systematic survey across disciplines. This enables higher visibility of datasets available to the research communities and can fo...
Article
In this review, we discuss how specific sensory channels can mediate the learning of properties of the environment. In recent years, schools have increasingly been using multisensory technology for teaching. However, it still needs to be sufficiently grounded in neuroscientific and pedagogical evidence. Researchers have recently renewed understandi...
Conference Paper
Students frequently multitask with social media (SM) during self-study. Such social media multitasking (SMM) has the potential either to support wellbeing by acting as a recovery activity or subvert it by acting as a procrastination activity. It is currently unclear which specific SM behaviours and related factors push SMM towards recovery or procr...
Article
Full-text available
The effects of music on bodily movement and feelings, such as when people are dancing or engaged in physical activity, are well-documented—people may move in response to the sound cues, feel powerful, less tired. How sounds and bodily movements relate to create such effects? Here we deconstruct the problem and investigate how different auditory fea...
Conference Paper
Segmentation of thermal facial images is a challenging task. This is because facial features often lack salience due to high-dynamic thermal range scenes and occlusion issues. Limited availability of datasets from unconstrained settings further limits the use of the state-of-the-art segmentation networks, loss functions and learning strategies whic...
Preprint
Full-text available
Breakthroughs in unsupervised domain adaptation (uDA) can help in adapting models from a label-rich source domain to unlabeled target domains. Despite these advancements, there is a lack of research on how uDA algorithms, particularly those based on adversarial learning, can work in distributed settings. In real-world applications, target domains a...
Article
Breakthroughs in unsupervised domain adaptation (uDA) can help in adapting models from a label-rich source domain to unlabeled target domains. Despite these advancements, there is a lack of research on how uDA algorithms, particularly those based on adversarial learning, can work in distributed settings. In real-world applications, target domains a...
Conference Paper
Full-text available
Pain is a ubiquitous and multifaceted experience, making the gath- ering of ground truth for training machine learning system partic- ularly difficult. In this paper, we reflect on the use of voice-based Experience Sampling Method (ESM) approaches for collecting pain self-reports in two different real-life case studies: long-distance run- ners, and...
Conference Paper
Full-text available
Orientation and mobility (O&M) training provides essential skills and techniques for safe and independent mobility for blind and partially sighted (BPS) people. The demand for O&M training is increasing as the number of people living with vision impairment increases. Despite the growing portfolio of HCI research on assistive technologies (AT), few...
Poster
Full-text available
Data from multiple sensors can boost the automatic recognition of multiple affective states in a multilabel and multimodal recognition system. At any time, the streaming from any of the contributing sensors can be missing. This work proposes a method for dealing with a missing sensor in a multilabel and multimodal automatic affective states recogni...
Conference Paper
Full-text available
Data from multiple sensors can boost the automatic recognition of multiple affective states in a multilabel and multi-modal recognition system. At any time, the streaming from any of the contributing sensors can be missing. This work proposes a method for dealing with a missing sensor in a multilabel and multimodal automatic affective states recogn...
Preprint
Full-text available
The effects of music on bodily movement and feelings, such as when people are dancing or engaged in physical activity, are well-documented - people may move in response to the sound cues, feel powerful, less tired. How sounds and bodily movements relate to create such effects? Here we deconstruct the problem and investigate how different auditory f...
Preprint
Full-text available
The annotation of domain experts is important for some medical applications where the objective ground truth is ambiguous to define, e.g., the rehabilitation for some chronic diseases, and the prescreening of some musculoskeletal abnormalities without further medical examinations. However, improper uses of the annotations may hinder developing reli...
Preprint
Full-text available
Figure 1: Factors that influence self-efficacy belief of blind and partially sighted people Orientation and mobility (O&M) training provides essential skills and techniques for safe and independent mobility for blind and partially sighted (BPS) people. The demand for O&M training is increasing as the number of people living with vision impairment i...
Article
Full-text available
Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through emb...
Preprint
Full-text available
Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through emb...
Article
Full-text available
Sensory information can temporarily affect mental body representations. For example, in Virtual Reality (VR), visually swapping into a body with another sex can temporarily alter perceived gender identity. Outside of VR, real-time auditory changes to walkers’ footstep sounds can affect perceived body weight and masculinity/femininity. Here, we inve...
Presentation
Purpose: Previous research reported adequate psychometric properties of the BQPA, which was developed based on barriers detected in the overweight population. To increase its generalizability, to the general population, the BQPA was revised based on a non-restricted literature review (BQPA-G). This study analyses the reliability, factor structure a...
Article
In chronic pain rehabilitation, physiotherapists adapt physical activity to patients’ performance based on their expression of protective behavior, gradually exposing them to feared but harmless and essential everyday activities. As rehabilitation moves outside the clinic, technology should automatically detect such behavior to provide similar supp...
Article
Full-text available
Protective behavior exhibited by people with chronic pain (CP) during physical activities is very informative to understanding their physical and emotional states. Existing automatic protective behavior detection (PBD) methods rely on pre-segmentation of activities predefined by users. However, in real life, people perform activities casually. Ther...
Conference Paper
Full-text available
The emerging possibilities of multisensory interactions provide an exciting space for disability and open up opportunities to explore new experiences for perceiving one's own body, it's interactions with the environment and also to explore the environment itself. In addition, dynamic aspects of living with disability, life transitions, including ag...
Conference Paper
Negative body perceptions are a major predictor of physical inactivity, a serious health concern. Sensory feedback can be used to alter such body perceptions; movement sonifcation, in particular, has been suggested to afect body perception and levels of physical activity (PA) in inactive people. We investigated how metaphorical sounds impact body p...
Poster
Introduction: Physical activity (PA) has significant health benefits. However, a third of the adult population across Europe is physically inactive and numbers are on the rise. To address this problem, a large body of the literature has tried to identify the variables influencing the adherence to PA (barriers or facilitators). Consequently, it is k...
Article
Full-text available
Interactive sonification is an effective tool used to guide individuals when practicing movements. Little research has shown the use of interactive sonification in supporting motor therapeutic interventions for children with autism who exhibit motor impairments. The goal of this research is to study if children with autism understand the use of int...
Article
Full-text available
Individuals tend to approach positive stimuli and avoid negative stimuli. Furthermore, emotions influence whether individuals freeze or move more. These two kinds of motivated behavior refer to the approach/avoidance behavior and behavioral freezing/activation. Previous studies examined (e.g., using forced platforms) whether individuals’ behavior d...
Article
Computational systems that process multiple affective states may benefit from explicitly considering the interaction between the states to enhance their recognition performance. This work proposes the combination of a multi-label classifier, Circular Classifier Chain (CCC), with a multimodal classifier, Fusion using a Semi-Naive Bayesian classifier...
Preprint
Full-text available
In chronic pain rehabilitation, physiotherapists adapt physical activity to patients’ performance based on their expression of protective behavior, gradually exposing them to feared but harmless and essential everyday activities. As rehabilitation moves outside the clinic, technology should automatically detect such behavior as to provide similar p...
Preprint
Full-text available
Protective behavior exhibited by people with chronic pain (CP) during physical activities is the key to understanding their physical and emotional states. Existing automatic protective behavior detection (PBD) methods rely on pre-segmentation of activity instances as they expect the activity types to be predefined by users. However, during real-lif...
Article
The EmoPain 2020 Challenge is the first international competition aimed at creating a uniform platform for the comparison of multi-modal machine learning and multimedia processing methods of chronic pain assessment from human expressive behaviour, and also the identification of pain-related behaviours. The objective of the challenge is to promote r...
Conference Paper
Full-text available
Interacting with natural environments such as parks and the countryside improves health and wellbeing. These spaces allow for exercise, relaxation, socialising and exploring nature, however, they are often not used by blind and partially sighted people (BPSP). To better understand the needs of BPSP for outdoor leisure experience and barriers encoun...
Conference Paper
Unsupervised domain adaptation using adversarial learning has shown promise in adapting speech models from a labeled source domain to an unlabeled target domain. However, prior works make a strong assumption that the label spaces of source and target domains are identical, which can be easily violated in real-world conditions. We present AMLS, an e...
Conference Paper
The use of multiple clocks has been a favoured approach to modelling the multiple timescales of sequential data. Previous work based on clocks and multi-timescale studies in general have not clearly accounted for multidimensionality of data such that each dimension has its own timescale(s). Focusing on body movement data which has independent yet c...
Conference Paper
We propose a novel neural network architecture, named the Global Workspace Network (GWN), which addresses the challenge of dynamic and unspecified uncertainties in multimodal data fusion. Our GWN is a model of attention across modalities and evolving through time, and is inspired by the well-established Global Workspace Theory from the field of cog...
Preprint
Full-text available
This paper introduces a new dataset, Libri-Adapt, to support unsupervised domain adaptation research on speech recognition models. Built on top of the LibriSpeech corpus, Libri-Adapt contains English speech recorded on mobile and embedded-scale microphones, and spans 72 different domains that are representative of the challenging practical scenario...
Conference Paper
Objective: This study aimed to develop the BQPA and evaluate its psychometric properties, which covers all the relevant barriers for Physical Activity (PA) reported in the literature. Method/Design: A cross-sectional study was performed in 2019 through a dedicated online panel. A sample of 610 participants was selected using a stratified random sam...
Preprint
Full-text available
Interacting with natural environments such as parks and the countryside improves health and wellbeing. These spaces allow for exercise, relaxation, socialising and exploring nature, however, they are often not used by blind and partially sighted people (BPSP). To better understand the needs of BPSP for outdoor leisure experience and barriers encoun...
Preprint
BACKGROUND Physical inactivity is a main risk factor of death worldwide, and contributes to psychological and physical problems, including obesity. Physical activity (PA) is critical to preventing health deterioration. Many technological interventions designed to promote PA have limited efficacy as some critical variables affecting PA are not consi...
Preprint
Full-text available
There is mounting evidence acknowledging that embodiment is foundational to cognition. In HCI, this understanding has been incorporated in concepts like embodied interaction , bodily play, and natural user-interfaces. However, while embodied cognition suggests a strong connection between motor activity and memory, we find the design of technologica...