Nadia Bianchi-Berthouze

Nadia Bianchi-Berthouze
University College London | UCL · UCL Interaction Centre

PhD

About

296
Publications
61,511
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
6,218
Citations
Additional affiliations
February 2006 - present
University College London
Position
  • Professor (Full)
Description
  • Reader in Affective Computing working on Affective body expression recognition, Affective touch, Full-body games technology, Technology for physical rehabilitation, Chronic Pain, Subjective interpretation of images, Affective Computing, Kansei Engineering

Publications

Publications (296)
Preprint
Reliable segmentation of thermal facial images in unconstrained settings such as thermal ambience and occlusions is challenging as facial features lack salience. Limited availability of datasets from such settings further makes it difficult to train segmentation networks. To address the challenge, we propose Self-Adversarial Multi-scale Contrastive...
Preprint
Full-text available
Background Experimental research based on bodily illusions suggests that people with eating disorders (EDs) might have impairments in visual, interoceptive, proprioceptive, and tactile perception, potentially underpinning altered multisensory integration processes. Along this line, research indicates that people with EDs show abnormalities in integ...
Article
Full-text available
Background: Many technological interventions designed to promote physical activity (PA) have limited efficacy and appear to lack important factors that could increase engagement. This may be due to a discrepancy between research conducted in this space, and software designers' and developers' use of this research to inform new digital applications...
Article
Movement dataset reviews exist but are limited in coverage, both in terms of size and research discipline. While topic-specific reviews clearly have their merit, it is critical to have a comprehensive overview based on a systematic survey across disciplines. This enables higher visibility of datasets available to the research communities and can fo...
Article
In this review, we discuss how specific sensory channels can mediate the learning of properties of the environment. In recent years, schools have increasingly been using multisensory technology for teaching. However, it still needs to be sufficiently grounded in neuroscientific and pedagogical evidence. Researchers have recently renewed understandi...
Conference Paper
Students frequently multitask with social media (SM) during self-study. Such social media multitasking (SMM) has the potential either to support wellbeing by acting as a recovery activity or subvert it by acting as a procrastination activity. It is currently unclear which specific SM behaviours and related factors push SMM towards recovery or procr...
Article
Full-text available
The effects of music on bodily movement and feelings, such as when people are dancing or engaged in physical activity, are well-documented—people may move in response to the sound cues, feel powerful, less tired. How sounds and bodily movements relate to create such effects? Here we deconstruct the problem and investigate how different auditory fea...
Preprint
Full-text available
Breakthroughs in unsupervised domain adaptation (uDA) can help in adapting models from a label-rich source domain to unlabeled target domains. Despite these advancements, there is a lack of research on how uDA algorithms, particularly those based on adversarial learning, can work in distributed settings. In real-world applications, target domains a...
Article
Breakthroughs in unsupervised domain adaptation (uDA) can help in adapting models from a label-rich source domain to unlabeled target domains. Despite these advancements, there is a lack of research on how uDA algorithms, particularly those based on adversarial learning, can work in distributed settings. In real-world applications, target domains a...
Conference Paper
Full-text available
Pain is a ubiquitous and multifaceted experience, making the gath- ering of ground truth for training machine learning system partic- ularly difficult. In this paper, we reflect on the use of voice-based Experience Sampling Method (ESM) approaches for collecting pain self-reports in two different real-life case studies: long-distance run- ners, and...
Conference Paper
Orientation and mobility (O&M) training provides essential skills and techniques for safe and independent mobility for blind and partially sighted (BPS) people. The demand for O&M training is increasing as the number of people living with vision impairment increases. Despite the growing portfolio of HCI research on assistive technologies (AT), few...
Poster
Full-text available
Data from multiple sensors can boost the automatic recognition of multiple affective states in a multilabel and multimodal recognition system. At any time, the streaming from any of the contributing sensors can be missing. This work proposes a method for dealing with a missing sensor in a multilabel and multimodal automatic affective states recogni...
Conference Paper
Full-text available
Data from multiple sensors can boost the automatic recognition of multiple affective states in a multilabel and multi-modal recognition system. At any time, the streaming from any of the contributing sensors can be missing. This work proposes a method for dealing with a missing sensor in a multilabel and multimodal automatic affective states recogn...
Preprint
Full-text available
The effects of music on bodily movement and feelings, such as when people are dancing or engaged in physical activity, are well-documented - people may move in response to the sound cues, feel powerful, less tired. How sounds and bodily movements relate to create such effects? Here we deconstruct the problem and investigate how different auditory f...
Preprint
Full-text available
The annotation of domain experts is important for some medical applications where the objective ground truth is ambiguous to define, e.g., the rehabilitation for some chronic diseases, and the prescreening of some musculoskeletal abnormalities without further medical examinations. However, improper uses of the annotations may hinder developing reli...
Preprint
Full-text available
Figure 1: Factors that influence self-efficacy belief of blind and partially sighted people Orientation and mobility (O&M) training provides essential skills and techniques for safe and independent mobility for blind and partially sighted (BPS) people. The demand for O&M training is increasing as the number of people living with vision impairment i...
Article
Full-text available
Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through emb...
Preprint
Full-text available
Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through emb...
Article
Full-text available
Sensory information can temporarily affect mental body representations. For example, in Virtual Reality (VR), visually swapping into a body with another sex can temporarily alter perceived gender identity. Outside of VR, real-time auditory changes to walkers’ footstep sounds can affect perceived body weight and masculinity/femininity. Here, we inve...
Presentation
Full-text available
Purpose: Previous research reported adequate psychometric properties of the BQPA, which was developed based on barriers detected in the overweight population. To increase its generalizability, to the general population, the BQPA was revised based on a non-restricted literature review (BQPA-G). This study analyses the reliability, factor structure a...
Article
In chronic pain rehabilitation, physiotherapists adapt physical activity to patients’ performance based on their expression of protective behavior, gradually exposing them to feared but harmless and essential everyday activities. As rehabilitation moves outside the clinic, technology should automatically detect such behavior to provide similar supp...
Article
Protective behavior exhibited by people with chronic pain (CP) during physical activities is very informative to understanding their physical and emotional states. Existing automatic protective behavior detection (PBD) methods rely on pre-segmentation of activities predefined by users. However, in real life, people perform activities casually. Ther...
Conference Paper
Full-text available
The emerging possibilities of multisensory interactions provide an exciting space for disability and open up opportunities to explore new experiences for perceiving one's own body, it's interactions with the environment and also to explore the environment itself. In addition, dynamic aspects of living with disability, life transitions, including ag...
Conference Paper
Negative body perceptions are a major predictor of physical inactivity, a serious health concern. Sensory feedback can be used to alter such body perceptions; movement sonifcation, in particular, has been suggested to afect body perception and levels of physical activity (PA) in inactive people. We investigated how metaphorical sounds impact body p...
Poster
Full-text available
Introduction: Physical activity (PA) has significant health benefits. However, a third of the adult population across Europe is physically inactive and numbers are on the rise. To address this problem, a large body of the literature has tried to identify the variables influencing the adherence to PA (barriers or facilitators). Consequently, it is k...
Article
Full-text available
Interactive sonification is an effective tool used to guide individuals when practicing movements. Little research has shown the use of interactive sonification in supporting motor therapeutic interventions for children with autism who exhibit motor impairments. The goal of this research is to study if children with autism understand the use of int...
Article
Full-text available
Individuals tend to approach positive stimuli and avoid negative stimuli. Furthermore, emotions influence whether individuals freeze or move more. These two kinds of motivated behavior refer to the approach/avoidance behavior and behavioral freezing/activation. Previous studies examined (e.g., using forced platforms) whether individuals’ behavior d...
Article
Computational systems that process multiple affective states may benefit from explicitly considering the interaction between the states to enhance their recognition performance. This work proposes the combination of a multi-label classifier, Circular Classifier Chain (CCC), with a multimodal classifier, Fusion using a Semi-Naive Bayesian classifier...
Preprint
Full-text available
In chronic pain rehabilitation, physiotherapists adapt physical activity to patients’ performance based on their expression of protective behavior, gradually exposing them to feared but harmless and essential everyday activities. As rehabilitation moves outside the clinic, technology should automatically detect such behavior as to provide similar p...
Preprint
Full-text available
Protective behavior exhibited by people with chronic pain (CP) during physical activities is the key to understanding their physical and emotional states. Existing automatic protective behavior detection (PBD) methods rely on pre-segmentation of activity instances as they expect the activity types to be predefined by users. However, during real-lif...
Article
The EmoPain 2020 Challenge is the first international competition aimed at creating a uniform platform for the comparison of multi-modal machine learning and multimedia processing methods of chronic pain assessment from human expressive behaviour, and also the identification of pain-related behaviours. The objective of the challenge is to promote r...
Conference Paper
Full-text available
Interacting with natural environments such as parks and the countryside improves health and wellbeing. These spaces allow for exercise, relaxation, socialising and exploring nature, however, they are often not used by blind and partially sighted people (BPSP). To better understand the needs of BPSP for outdoor leisure experience and barriers encoun...
Conference Paper
Unsupervised domain adaptation using adversarial learning has shown promise in adapting speech models from a labeled source domain to an unlabeled target domain. However, prior works make a strong assumption that the label spaces of source and target domains are identical, which can be easily violated in real-world conditions. We present AMLS, an e...
Conference Paper
The use of multiple clocks has been a favoured approach to modelling the multiple timescales of sequential data. Previous work based on clocks and multi-timescale studies in general have not clearly accounted for multidimensionality of data such that each dimension has its own timescale(s). Focusing on body movement data which has independent yet c...
Conference Paper
We propose a novel neural network architecture, named the Global Workspace Network (GWN), which addresses the challenge of dynamic and unspecified uncertainties in multimodal data fusion. Our GWN is a model of attention across modalities and evolving through time, and is inspired by the well-established Global Workspace Theory from the field of cog...
Preprint
Full-text available
This paper introduces a new dataset, Libri-Adapt, to support unsupervised domain adaptation research on speech recognition models. Built on top of the LibriSpeech corpus, Libri-Adapt contains English speech recorded on mobile and embedded-scale microphones, and spans 72 different domains that are representative of the challenging practical scenario...
Conference Paper
Full-text available
Objective: This study aimed to develop the BQPA and evaluate its psychometric properties, which covers all the relevant barriers for Physical Activity (PA) reported in the literature. Method/Design: A cross-sectional study was performed in 2019 through a dedicated online panel. A sample of 610 participants was selected using a stratified random sam...
Preprint
Full-text available
Interacting with natural environments such as parks and the countryside improves health and wellbeing. These spaces allow for exercise, relaxation, socialising and exploring nature, however, they are often not used by blind and partially sighted people (BPSP). To better understand the needs of BPSP for outdoor leisure experience and barriers encoun...
Preprint
BACKGROUND Physical inactivity is a main risk factor of death worldwide, and contributes to psychological and physical problems, including obesity. Physical activity (PA) is critical to preventing health deterioration. Many technological interventions designed to promote PA have limited efficacy as some critical variables affecting PA are not consi...
Preprint
Full-text available
There is mounting evidence acknowledging that embodiment is foundational to cognition. In HCI, this understanding has been incorporated in concepts like embodied interaction , bodily play, and natural user-interfaces. However, while embodied cognition suggests a strong connection between motor activity and memory, we find the design of technologica...
Article
Full-text available
When designing movement sonifications, their effect on people’s movement must be considered. Recent work has shown how real-time sonification can be designed to alter the way people move. However, the mechanisms through which these sonifications alter people’s expectations of their movement is not well explained. This is especially important when c...
Preprint
Mobile and embedded devices are increasingly using microphones and audio-based computational models to infer user context. A major challenge in building systems that combine audio models with commodity microphones is to guarantee their accuracy and robustness in the real-world. Besides many environmental dynamics, a primary factor that impacts the...
Conference Paper
Convolutional neural networks (CNNs) offer great machine learning performance over a range of applications, but their operation is hard to interpret, even for experts. Various explanation algorithms have been proposed to address this issue, yet limited research effort has been reported concerning their user evaluation. In this paper, we report on a...
Article
For technology (like serious games) that aims to deliver interactive learning, it is important to address relevant mental experiences such as reflective thinking during problem solving. To facilitate research in this direction, we present the weDraw-1 Movement Dataset of body movement sensor data and reflective thinking labels for 26 children solvi...
Preprint
Convolutional neural networks (CNNs) offer great machine learning performance over a range of applications, but their operation is hard to interpret, even for experts. Various explanation algorithms have been proposed to address this issue, yet limited research effort has been reported concerning their user evaluation. In this paper, we report on a...
Preprint
We propose a novel neural network architecture, named the Global Workspace Network (GWN), that addresses the challenge of dynamic uncertainties in multimodal data fusion. The GWN is inspired by the well-established Global Workspace Theory from cognitive science. We implement it as a model of attention, between multiple modalities, that evolves thro...
Preprint
Full-text available
The EmoPain 2020 Challenge is the first international competition aimed at creating a uniform platform for the comparison of machine learning and multimedia processing methods of automatic chronic pain assessment from human expressive behaviour, and also the identification of pain-related behaviours. The objective of the challenge is to promote res...
Conference Paper
Full-text available
Automatically monitoring and quantifying stress induced thermal dynamic information in real-world settings is an extremely important but challenging problem. In this paper, we explore whether we can use mobile thermal imaging to measure the rich physiological cues of mental stress that can be deduced from a person’s nose temperature. To answer this...
Conference Paper
Full-text available
The automatic recognition of multiple affective states can be enhanced if the underpinning computational models explicitly consider the interactions between the states. This work proposes a computational model that incorporates the dependencies between four states (tiredness, anxiety, pain, and engagement)known to appear in virtual rehabilitation s...
Conference Paper
Despite significant advances in the performance of sensory inference models, their poor robustness to changing environmental conditions and hardware remains a major hurdle for widespread adoption. In this paper, we introduce the concept of unsupervised domain adaptation which is a technique to adapt sensory inference models to new domains only usin...
Conference Paper
Full-text available
The automatic recognition of multiple affective states can be enhanced if the underpinning computational models explicitly consider the interactions between the states. This work proposes a computational model that incorporates the dependencies between four states (tiredness, anxiety, pain, and engagement) known to appear in virtual rehabilitation...
Conference Paper
Full-text available
For people with chronic pain, the assessment of protective behavior during physical functioning is essential to understand their subjective pain-related experiences (e.g., fear and anxiety toward pain and injury) and how they deal with such experiences (avoidance or reliance on specific body joints), with the ultimate goal of guiding intervention....
Preprint
Thermal imaging-based physiological and affective computing is an emerging research area enabling technologies to monitor our bodily functions and understand psychological and affective needs in a contactless manner. However, up to recently, research has been mainly carried out in very controlled lab settings. As small size and even low-cost versio...
Chapter
How people mentally represent their body appearance (i.e., body image perception - BIP) does not always match their actual body. BIP distortions can lead to a detriment in physical and emotional health. Recent works in HCI have shown that technology can be used to change people’s BIP through visual, tactile, proprioceptive, and auditory stimulation...
Conference Paper
Full-text available
For people with chronic pain, the assessment of protective behavior during physical functioning is essential to understand their subjective pain-related experiences (e.g., fear and anxiety toward pain and injury) and how they deal with such experiences (avoidance or reliance on specific body joints), with the ultimate goal of guiding intervention....
Conference Paper
Full-text available
In chronic pain physical rehabilitation, physiotherapists adapt exercise sessions according to the movement behavior of patients. As rehabilitation moves beyond clinical sessions, technology is needed to similarly assess movement behaviors and provide such personalized support. In this paper, as a first step, we investigate automatic detection of p...
Article
Full-text available
Introduction: Pain-related behavior in people with chronic pain is often overlooked in a focus on increasing the amount of activity, yet it may limit activity and maintain pain and disability. Targeting it in treatment requires better understanding of the role of beliefs, emotion, and pain in pain behavior. Objectives: This study aimed to clarif...
Preprint
Automatically monitoring and quantifying stress-induced thermal dynamic information in real-world settings is an extremely important but challenging problem. In this paper, we explore whether we can use mobile thermal imaging to measure the rich physiological cues of mental stress that can be deduced from a person's nose temperature. To answer this...