Jean-Claude MartinComputer Sciences Laboratory for Mechanics and Engineering Sciences | LIMSI · Département Communication Homme-Machine
Jean-Claude Martin
PhD in Computer Science
About
299
Publications
75,594
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
4,916
Citations
Introduction
I am Professor of Computer Science (1st class: PR1) at Université Paris Sud, France.
I conduct my research at LIMSI-CNRS where I head a team of researchers in Psychology and researchers in Computer Sciences. My research domain is Social and Affective Multimodal Interaction in Humans and in Machines. I work in several application areas related to social skills training: autism ; job and medical interviews ; virtual coaches ; leadership and teamwork ; stress management ; sports and e-Health.
Additional affiliations
September 2009 - present
September 1999 - August 2009
September 1991 - present
Publications
Publications (299)
Background
Mindfulness improves well-being, improves emotional regulation, reduces impulses to eat, and is linked to increased physical activity. Mindfulness interventions usually focus on 1 aspect but do not offer an approach to holistically improving lifestyle.
Objective
This study aims to address this gap by designing and evaluating a holistic...
BACKGROUND
Social communication is a crucial factor influencing human social life. Quantifying the degree of difficulty faced in social communication is necessary for understanding developmental and neurological disorders and for creating systems used in automatic symptom screening and assistive methods such as social skills training. Social skills...
Despite both WHO's recommendation to increase the levels of physical activity, and the existence of numerous intervention programs, there is still a lack of sustainable tools to help people adopt and maintain a healthy level of physical activity. Currently, motivational technologies aimed at positively influencing user behavior seem to be relevant....
Sedentary lifestyles and lack of physical activity place a financial burden on health services. Although the World Health Organization (WHO) recommends people to increase levels of physical activity, more than 80% of adolescents and 27% of adults do not meet such WHO recommendations (Global status report on physical activity, 2022). Running is an a...
While multiple studies suggest that social skills are considered as essential in promoting employment, literature highlights a deficit in these skills among workers with Autism Spectrum Disorder (ASD) for whom difficulties in communication and social interaction are often reported. In this article, we explain how we used a User-Centered Design to i...
1. Problématique
Les personnes en situation de handicap sont souvent confrontées au chômage ou au sous-emploi. En France, leur taux de chômage est de 14% contre 8% pour la population générale (Agefiph, 2021). Or le passage et le maintien dans l’emploi sont importants car ils entraînent une plus grande autonomie induisant d'importantes répercussions...
Physical inactivity and sedentary lifestyles are major health-related risk factors. Running is quite relevant when studying
the design and implementation of interventions aiming at increasing PA levels, as it is a very popular activity. A growing
strategy to promote PA is to design interventions using “motivational technology.”
Several commercial a...
Objectives
People with disabilities and neurodevelopmental disorders, such as autistic people, often face unemployment or underemployment. This can be partly explained by their difficulties in social situations and in particular in the use of social skills. Obtaining and keeping a job has an important influence on the quality of life of individuals...
BACKGROUND
Mindfulness improves well-being, improves emotional regulation, reduces impulses to eat, and is linked to increased physical activity. Mindfulness interventions usually focus on 1 aspect but do not offer an approach to holistically improving lifestyle.
OBJECTIVE
This study aims to address this gap by designing and evaluating a holistic...
Functional Status Information (FSI) describes physical and mental wellness at the whole-person level. It includes information on activity performance, social role participation, and environmental and personal factors that affect the well-being and quality of life. Collecting and analyzing this information is critical to address the needs for caring...
Context
Behavioral observation scales are important for understanding and assessing social skills. In the context of collaborative problem-solving (CPS) skills, considered essential in the 21st century, there are no validated scales in French that can be adapted to different CPS tasks. The aim of this study is to adapt and validate, by annotating a...
Background: Individuals with Autism Spectrum Disorder (ASD) have pronounced difficulties in attending to relevant visual information during social interactions. Method: We designed and evaluated the feasibility of a novel method to train this ability, by exposing participants to virtual human characters displayed on a screen which was entirely blur...
The transition into the workplace for adults with autism and intellectual disability can be challenging. As a result, they often face unemployment or underemployment. This may be due to their deficits in social interaction. As new technologies can be a real lever in compensating for these deficits, this pilot study aimed to design a tablet-based tr...
Clinician-patient communication is essential to successful care and treatment. However, health training programs do not provide sufficient clinical exposure to practice communication skills that are pivotal when interacting with patients exhibiting mental health or age-related disorders. Recently, virtual reality has been used to develop simulation...
Les personnes en situation de handicap ont trois fois moins de chances d’être en emploi en comparaison à la population générale à caractéristiques identiques, et deux fois plus de risque d’être au chômage (enquête de la DARES, 2015). Or le fait de ne pas trouver un emploi peut avoir un impact négatif sur le statut socio-économique, la qualité de vi...
Background
Low back pain is a major public health problem that is increasing with the aging of the population. It is the leading cause of disability in most countries [1]. The recommendations of Inserm (2019) include personalized physical activity programs according to the individual characteristics (motivation, preferences, attitude towards physic...
Background
Diabetes is a chronic disease. A sustained change in lifestyle is generally necessary for terms of diet and physical activity. According to Self-Determination Theory, the nature of the motivation to regulate one’s behavior is linked to the satisfaction of three psychological needs: autonomy, competence, and relatedness. According to Regu...
Introduction
La lombalgie est un problème majeur de santé publique qui augmente avec le vieillissement de la population. Elle est la première cause d’invalidité dans la plupart des pays. Les recommandations de l’Inserm (2019) sont de proposer des programmes d’activité physique personnalisés en fonction des caractéristiques individuelles (motivation...
se of machine learning for automatic analysis of job interview videos has recently seen increased interest. Despite claims of fair output regarding sensitive information such as gender or ethnicity of the candidates, the current approaches rarely provide proof of unbiased decision-making, or that sensitive information is not used. Recently, adversa...
Contemporary societies are comprised of individuals very diverse in terms of culture, status, gender and age. In this context, there is no single system behaviour that fits all users, not even considering the traditional “personalization” efforts of adaptable systems, in which individual users can explicitly tailor some system features to their nee...
Automatic analysis of job interviews has gained in interest amongst academic and industrial research. The particular case of asynchronous video interviews allows to collect vast corpora of videos where candidates answer standardized questions in monologue videos, enabling the use of deep learning algorithms. On the other hand, state-of-the-art appr...
Virtual agents used in storytelling applications should display consistent and natural multimodal expressions of emotions. In this paper, we describe the method that we defined to endow virtual narrators with individual gesture profiles. We explain how we collected a corpus of gestural behaviors displayed by different actors telling the same story....
Postural interaction is of major importance during job interviews. While several prototypes enable users to rehearse for public speaking tasks and job interviews, few of these prototypes support subtle bodily interactions between the user and a virtual agent playing the role of an interviewer. The design of our system is informed by a multimodal co...
Background
Impairments in joint attention are considered a hallmark of the Autism Spectrum Disorder (ASD). Yet, the ability of people with ASD to lead the attentional focus of others has been scarcely investigated.
Method
To address this issue, we designed virtual avatars that can follow the gaze of participants with head and eye movements in real...
The impact of non verbal behaviour in a hiring decision remains an open question. Investigating this question is important, as it could provide a better understanding on how to train candidates for job interviews and make recruiters be aware of influential non verbal behaviour. This research has recently been accelerated due to the development of t...
New technologies drastically change recruitment techniques. Some research projects aim at designing interactive systems that help candidates practice job interviews. Other studies aim at the automatic detection of social signals (e.g. smile, turn of speech, etc...) in videos of job interviews. These studies are limited with respect to the number of...
New technologies drastically change recruitment techniques. Some research projects aim at designing interactive systems that help candidates practice job interviews. Other studies aim at the automatic detection of social signals (e.g. smile, turn of speech, etc...) in videos of job interviews. These studies are limited with respect to the number of...
Managing a medical team in emergency situations requires not only technical but also non-technical skills. Leaders must train to manage different types of subordinates, and how these subordinates will respond to orders and stressful events. Before designing virtual training environments for these leaders, it is necessary to understand how leaders p...
Health care delivery in military conflict, in peacekeeping missions or in the aftermath of disaster, implies high stress environments with danger exposures, life-threatening events and high levels of work demand. Crisis and emergency risk communication remains a real challenge. The rapid response of emergency medical teams has an important role to...
In the context of designing multimodal social interactions for Human–Computer Interaction and for Computer–Mediated Communication, we conducted an experimental study to investigate how participants combine voice expressions with tactile stimulation to evaluate emotional valence (EV). In this study, audio and tactile stimuli were presented separatel...
Hundreds of well-being apps aim to manage stress. Despite some successes in developing personalized regimes for stress coaching, current apps are still far from offering a compelling user experience. We discuss the requirements and technical challenges underlying the design of a virtual coach, including the critical need to support both personaliza...
In this paper, we describe a new theoretically motivated application framework, Wenner, for developing tailored interactions for an exercise-oriented well-being application. The framework allows us to conduct in-lab and 'in the wild' studies to directly deploy and evaluate the effects of our interventions. We describe two systems that have been dev...
Diriger une équipe médicale d'urgence nécessite de la part des leaders médicaux des compétences non techniques leur permettant par exemple de savoir gérer les comportements non-verbaux de différents types de subordonnés. Construire un modèle de comportements non verbaux pour de tels subordonnés médicaux virtuels dans un environnement virtuel de for...
Facial expressions of emotion provide relevant cues for understanding social interactions and the affective processes involved in emotion perception. Virtual human faces are useful for conducting controlled experiments. However, little is known regarding the possible differences between physiological responses elicited by virtual versus real human...
A growing body of evidence from Psychology and Sport Sciences shows that physical activity can be a cost-effective and safe intervention for the prevention and treatment of a wide range of mental and physical health problems. Research in domains such as the Internet of Things (IoT), wearables and persuasive technologies suggest that a coach intende...
Previous studies about kinesthetic expressions of emotions are mainly based on acted expressions of emotions, which can be quite different from spontaneous expressions. This paper describes a study involving a stress induction procedure and stress perception through haptic expressions with $N_{\mathrm{total}} = 41$ young men (aged $19 - 37$ ), all...
In this article, effectiveness of air jet stimulation in mediated emotional communication was investigated by assessing cross-modal influences of visual emotional expressions on tactile perception. Brain responses to combined visual faces and air jet stimuli were measured using event-related potentials; whereas, emotional responses were assessed us...
Les nouvelles technologies pour le grand public se sont beaucoup développées ces dernières années. C’est aussi le cas des recherches en traitement informatique des émotions et des comportements sociaux appliquées à l’entraînement de compétences sociales à l’aide d’agents virtuels. Un agent virtuel est un personnage animé dont les comportements (exp...
This study investigates a specific aspect of joint attention, that is, the emergence of the sense that one is leading the attentional focus of others. Thirty participants were placed in front of two avatars and had to pay attention to objects that were also attended to by the avatars. Unbeknownst to the participant, the avatars’ gaze orientations w...
The aim of the present study is to identify relevant nonverbal features allowing the discrimination of different stressful behaviors, with the consideration of personality factors. In order to achieve this aim, we propose a new method for psychological stress induction involving four different stressful tasks. The proposed protocol was tested with...
A growing body of evidence from Psychology and Sport Sciences shows that physical activity can be a cost-effective and safe intervention for the prevention and treatment of a wide range of mental and physical health problems. Research in domains such as the Internet of Things (IoT), wearables and persuasive technologies suggest that a coach intende...
Expression of emotions and interruption management are two major capabilities that should be displayed by Embodied Conversational Agents. Yet, no work have linked interruption management and emotions. In this paper, we introduce a new model for interruption management that considers one component of emotions: the action tendency. We explain how the...
People react with Rapid Facial Reactions (RFRs) when presented with human facial emotional expressions. Recent studies show that RFRs are not always congruent with emotional cues. The processes underlying RFRs are still being debated. In our study described herein, we manipulate the context of perception and its influence on RFRs. We use a sublimin...
Abstract: In this paper, we presented a method to define individual profiles in order to develop a new personalized robot -based social interaction for individual with Autistic Spectrum Disorder (ASD) with the hypothesis that hyporeactivity to visual motion and an overreliance on proprioceptive information would be linked to difficulties in integra...
Imitation is of major importance during social interactions, would it be between humans or between a human and a robot. This is even more true when considering users with special needs. In this paper, we describe an experimental imitation task protocol using a robot Nao that we designed to assess whether sensory profiles of children with Autistic S...
We design a personalized human-robot environment for social learning for individuals with autism spectrum disorders (ASD). In order to define an individual’s profile, we posit that the individual’s reliance on proprioceptive and kinematic visual cues should affect the way the individual suffering from ASD interacts with a social agent (human/robot/...
The purpose of the present research is to design a new self-report questionnaire to assess individuals' orientations toward their goals based on the regulatory focus theory. This theory distinguishes self-regulation with a promotion focus from self-regulation with a prevention focus. Our questionnaire is different from the existing Regulatory Focus...
Gaze plays a pivotal role in human communication, especially for coordinating attention. The ability to guide the gaze orientation of others forms the backbone of joint attention. Recent research has raised the possibility that gaze following behaviors could induce liking. The present study seeks to investigate this hypothesis. We designed two phys...
This paper focuses on the development of an expressive virtual storyteller for children and raises the challenges encountered to endow a virtual agent with storytelling capabilities. We focus on facial expressions of emotions and we present our computational model based on an appraisal theory of emotion. We also discuss diüerent viewpoints a storyt...
Cet article explore comment la dimension affective dune histoire peut être prise en compte dans le cadre dune narration réalisée par un agent virtuel et quel est son apport pour la compréhension. Nous proposons un modèle computationnel qui sappuie sur le modèle dévaluation cognitive des émotions (appraisal) proposé par Scherer (2001) pour doter...
We conducted an experimental study to investigate how the participants combine touch and facial expression to evaluate emotional valence. In this study, visual and haptic stimuli were presented separately and then presented together. The visual stimuli comprised pictures of facial expressions with different emotional levels, and the touch stimuli c...
The purpose of the present study was to evaluate the impact of four mood conditions (control, positive, negative, aroused) on movement expressivity during a fitness task. Motion capture data from twenty individuals were recorded as they performed a predefined motion sequence. Moods were elicited using task-specific scenarii to keep a valid context....
In this paper, we present a framework for an expressive virtual storyteller for children. Our virtual storyteller displays facial expressions of appraisals related to story events. The facial expressions are animated jointly with deictic gestures towards graphical elements representing story events. We describe a preliminary study that we conducted...