Jean-Claude Martin

Jean-Claude Martin
Computer Sciences Laboratory for Mechanics and Engineering Sciences | LIMSI · Département Communication Homme-Machine

PhD in Computer Science

About

275
Publications
58,136
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
3,979
Citations
Citations since 2016
62 Research Items
1776 Citations
2016201720182019202020212022050100150200250
2016201720182019202020212022050100150200250
2016201720182019202020212022050100150200250
2016201720182019202020212022050100150200250
Introduction
I am Professor of Computer Science (1st class: PR1) at Université Paris Sud, France. I conduct my research at LIMSI-CNRS where I head a team of researchers in Psychology and researchers in Computer Sciences. My research domain is Social and Affective Multimodal Interaction in Humans and in Machines. I work in several application areas related to social skills training: autism ; job and medical interviews ; virtual coaches ; leadership and teamwork ; stress management ; sports and e-Health.
Additional affiliations
September 2009 - present
Université Paris-Sud 11
Position
  • Professor (Full)
September 1999 - August 2009
Université de Vincennes - Paris 8
Position
  • Professor (Associate)
September 1991 - present
French National Centre for Scientific Research
Position
  • Professor (Full)

Publications

Publications (275)
Article
Background: Individuals with Autism Spectrum Disorder (ASD) have pronounced difficulties in attending to relevant visual information during social interactions. Method: We designed and evaluated the feasibility of a novel method to train this ability, by exposing participants to virtual human characters displayed on a screen which was entirely blur...
Article
Full-text available
ContextBehavioral observation scales are important for understanding and assessing social skills. In the context of collaborative problem-solving (CPS) skills, considered essential in the 21st century, there are no validated scales in French that can be adapted to different CPS tasks. The aim of this study is to adapt and validate, by annotating a...
Poster
The transition into the workplace for adults with autism and intellectual disability can be challenging. As a result, they often face unemployment or underemployment. This may be due to their deficits in social interaction. As new technologies can be a real lever in compensating for these deficits, this pilot study aimed to design a tablet-based tr...
Article
Full-text available
Clinician-patient communication is essential to successful care and treatment. However, health training programs do not provide sufficient clinical exposure to practice communication skills that are pivotal when interacting with patients exhibiting mental health or age-related disorders. Recently, virtual reality has been used to develop simulation...
Conference Paper
Les personnes en situation de handicap ont trois fois moins de chances d’être en emploi en comparaison à la population générale à caractéristiques identiques, et deux fois plus de risque d’être au chômage (enquête de la DARES, 2015). Or le fait de ne pas trouver un emploi peut avoir un impact négatif sur le statut socio-économique, la qualité de vi...
Article
Background Low back pain is a major public health problem that is increasing with the aging of the population. It is the leading cause of disability in most countries [1]. The recommendations of Inserm (2019) include personalized physical activity programs according to the individual characteristics (motivation, preferences, attitude towards physic...
Article
Background Diabetes is a chronic disease. A sustained change in lifestyle is generally necessary for terms of diet and physical activity. According to Self-Determination Theory, the nature of the motivation to regulate one’s behavior is linked to the satisfaction of three psychological needs: autonomy, competence, and relatedness. According to Regu...
Article
Introduction La lombalgie est un problème majeur de santé publique qui augmente avec le vieillissement de la population. Elle est la première cause d’invalidité dans la plupart des pays. Les recommandations de l’Inserm (2019) sont de proposer des programmes d’activité physique personnalisés en fonction des caractéristiques individuelles (motivation...
Preprint
Full-text available
se of machine learning for automatic analysis of job interview videos has recently seen increased interest. Despite claims of fair output regarding sensitive information such as gender or ethnicity of the candidates, the current approaches rarely provide proof of unbiased decision-making, or that sensitive information is not used. Recently, adversa...
Chapter
Contemporary societies are comprised of individuals very diverse in terms of culture, status, gender and age. In this context, there is no single system behaviour that fits all users, not even considering the traditional “personalization” efforts of adaptable systems, in which individual users can explicitly tailor some system features to their nee...
Article
Automatic analysis of job interviews has gained in interest amongst academic and industrial research. The particular case of asynchronous video interviews allows to collect vast corpora of videos where candidates answer standardized questions in monologue videos, enabling the use of deep learning algorithms. On the other hand, state-of-the-art appr...
Article
Virtual agents used in storytelling applications should display consistent and natural multimodal expressions of emotions. In this paper, we describe the method that we defined to endow virtual narrators with individual gesture profiles. We explain how we collected a corpus of gestural behaviors displayed by different actors telling the same story....
Article
Full-text available
Postural interaction is of major importance during job interviews. While several prototypes enable users to rehearse for public speaking tasks and job interviews, few of these prototypes support subtle bodily interactions between the user and a virtual agent playing the role of an interviewer. The design of our system is informed by a multimodal co...
Article
Background Impairments in joint attention are considered a hallmark of the Autism Spectrum Disorder (ASD). Yet, the ability of people with ASD to lead the attentional focus of others has been scarcely investigated. Method To address this issue, we designed virtual avatars that can follow the gaze of participants with head and eye movements in real...
Preprint
Full-text available
The impact of non verbal behaviour in a hiring decision remains an open question. Investigating this question is important, as it could provide a better understanding on how to train candidates for job interviews and make recruiters be aware of influential non verbal behaviour. This research has recently been accelerated due to the development of t...
Preprint
Full-text available
New technologies drastically change recruitment techniques. Some research projects aim at designing interactive systems that help candidates practice job interviews. Other studies aim at the automatic detection of social signals (e.g. smile, turn of speech, etc...) in videos of job interviews. These studies are limited with respect to the number of...
Article
Full-text available
New technologies drastically change recruitment techniques. Some research projects aim at designing interactive systems that help candidates practice job interviews. Other studies aim at the automatic detection of social signals (e.g. smile, turn of speech, etc...) in videos of job interviews. These studies are limited with respect to the number of...
Conference Paper
Full-text available
Managing a medical team in emergency situations requires not only technical but also non-technical skills. Leaders must train to manage different types of subordinates, and how these subordinates will respond to orders and stressful events. Before designing virtual training environments for these leaders, it is necessary to understand how leaders p...
Conference Paper
Health care delivery in military conflict, in peacekeeping missions or in the aftermath of disaster, implies high stress environments with danger exposures, life-threatening events and high levels of work demand. Crisis and emergency risk communication remains a real challenge. The rapid response of emergency medical teams has an important role to...
Conference Paper
Full-text available
Hundreds of well-being apps aim to manage stress. Despite some successes in developing personalized regimes for stress coaching, current apps are still far from offering a compelling user experience. We discuss the requirements and technical challenges underlying the design of a virtual coach, including the critical need to support both personaliza...
Conference Paper
Full-text available
In this paper, we describe a new theoretically motivated application framework, Wenner, for developing tailored interactions for an exercise-oriented well-being application. The framework allows us to conduct in-lab and 'in the wild' studies to directly deploy and evaluate the effects of our interventions. We describe two systems that have been dev...
Article
Full-text available
In the context of designing multimodal social interactions for Human–Computer Interaction and for Computer–Mediated Communication, we conducted an experimental study to investigate how participants combine voice expressions with tactile stimulation to evaluate emotional valence (EV). In this study, audio and tactile stimuli were presented separatel...
Preprint
Full-text available
Diriger une équipe médicale d'urgence nécessite de la part des leaders médicaux des compétences non techniques leur permettant par exemple de savoir gérer les comportements non-verbaux de différents types de subordonnés. Construire un modèle de comportements non verbaux pour de tels subordonnés médicaux virtuels dans un environnement virtuel de for...
Article
Full-text available
Facial expressions of emotion provide relevant cues for understanding social interactions and the affective processes involved in emotion perception. Virtual human faces are useful for conducting controlled experiments. However, little is known regarding the possible differences between physiological responses elicited by virtual versus real human...
Chapter
Full-text available
A growing body of evidence from Psychology and Sport Sciences shows that physical activity can be a cost-effective and safe intervention for the prevention and treatment of a wide range of mental and physical health problems. Research in domains such as the Internet of Things (IoT), wearables and persuasive technologies suggest that a coach intende...
Article
Full-text available
Previous studies about kinesthetic expressions of emotions are mainly based on acted expressions of emotions, which can be quite different from spontaneous expressions. This paper describes a study involving a stress induction procedure and stress perception through haptic expressions with $N_{\mathrm{total}} = 41$ young men (aged $19 - 37$ ), all...
Article
Full-text available
In this article, effectiveness of air jet stimulation in mediated emotional communication was investigated by assessing cross-modal influences of visual emotional expressions on tactile perception. Brain responses to combined visual faces and air jet stimuli were measured using event-related potentials; whereas, emotional responses were assessed us...
Article
Les nouvelles technologies pour le grand public se sont beaucoup développées ces dernières années. C’est aussi le cas des recherches en traitement informatique des émotions et des comportements sociaux appliquées à l’entraînement de compétences sociales à l’aide d’agents virtuels. Un agent virtuel est un personnage animé dont les comportements (exp...
Article
This study investigates a specific aspect of joint attention, that is, the emergence of the sense that one is leading the attentional focus of others. Thirty participants were placed in front of two avatars and had to pay attention to objects that were also attended to by the avatars. Unbeknownst to the participant, the avatars’ gaze orientations w...
Conference Paper
Full-text available
The aim of the present study is to identify relevant nonverbal features allowing the discrimination of different stressful behaviors, with the consideration of personality factors. In order to achieve this aim, we propose a new method for psychological stress induction involving four different stressful tasks. The proposed protocol was tested with...
Conference Paper
Full-text available
A growing body of evidence from Psychology and Sport Sciences shows that physical activity can be a cost-effective and safe intervention for the prevention and treatment of a wide range of mental and physical health problems. Research in domains such as the Internet of Things (IoT), wearables and persuasive technologies suggest that a coach intende...
Conference Paper
Full-text available
Expression of emotions and interruption management are two major capabilities that should be displayed by Embodied Conversational Agents. Yet, no work have linked interruption management and emotions. In this paper, we introduce a new model for interruption management that considers one component of emotions: the action tendency. We explain how the...
Article
People react with Rapid Facial Reactions (RFRs) when presented with human facial emotional expressions. Recent studies show that RFRs are not always congruent with emotional cues. The processes underlying RFRs are still being debated. In our study described herein, we manipulate the context of perception and its influence on RFRs. We use a sublimin...
Book
Full-text available
Abstract: In this paper, we presented a method to define individual profiles in order to develop a new personalized robot -based social interaction for individual with Autistic Spectrum Disorder (ASD) with the hypothesis that hyporeactivity to visual motion and an overreliance on proprioceptive information would be linked to difficulties in integra...
Conference Paper
Imitation is of major importance during social interactions, would it be between humans or between a human and a robot. This is even more true when considering users with special needs. In this paper, we describe an experimental imitation task protocol using a robot Nao that we designed to assess whether sensory profiles of children with Autistic S...
Article
Full-text available
We design a personalized human-robot environment for social learning for individuals with autism spectrum disorders (ASD). In order to define an individual’s profile, we posit that the individual’s reliance on proprioceptive and kinematic visual cues should affect the way the individual suffering from ASD interacts with a social agent (human/robot/...
Article
The purpose of the present research is to design a new self-report questionnaire to assess individuals' orientations toward their goals based on the regulatory focus theory. This theory distinguishes self-regulation with a promotion focus from self-regulation with a prevention focus. Our questionnaire is different from the existing Regulatory Focus...
Article
Gaze plays a pivotal role in human communication, especially for coordinating attention. The ability to guide the gaze orientation of others forms the backbone of joint attention. Recent research has raised the possibility that gaze following behaviors could induce liking. The present study seeks to investigate this hypothesis. We designed two phys...
Article
Full-text available
This paper focuses on the development of an expressive virtual storyteller for children and raises the challenges encountered to endow a virtual agent with storytelling capabilities. We focus on facial expressions of emotions and we present our computational model based on an appraisal theory of emotion. We also discuss diüerent viewpoints a storyt...
Article
Full-text available
Cet article explore comment la dimension affective d’une histoire peut être prise en compte dans le cadre d’une narration réalisée par un agent virtuel et quel est son apport pour la compréhension. Nous proposons un modèle computationnel qui s’appuie sur le modèle d’évaluation cognitive des émotions (appraisal) proposé par Scherer (2001) pour doter...
Article
Full-text available
We conducted an experimental study to investigate how the participants combine touch and facial expression to evaluate emotional valence. In this study, visual and haptic stimuli were presented separately and then presented together. The visual stimuli comprised pictures of facial expressions with different emotional levels, and the touch stimuli c...
Article
The purpose of the present study was to evaluate the impact of four mood conditions (control, positive, negative, aroused) on movement expressivity during a fitness task. Motion capture data from twenty individuals were recorded as they performed a predefined motion sequence. Moods were elicited using task-specific scenarii to keep a valid context....
Conference Paper
In this paper, we present a framework for an expressive virtual storyteller for children. Our virtual storyteller displays facial expressions of appraisals related to story events. The facial expressions are animated jointly with deictic gestures towards graphical elements representing story events. We describe a preliminary study that we conducted...
Article
Full-text available
The present study aimed to examine multidimensional factors that contribute to a poor performance in a public speaking task. An adapted version of the Trier Social Stress Test (TSST) as used to elicit psychosocial stress among 43 university students and multidimensional assessments were involved to investigate acute stress responses by psychologica...
Article
Independent and interdependent self-construals are included in individuals’ self-definitions. The 24-item Self-Construal Scale (SCS) was developed by Singelis (1994) as a means of measuring the “two selves” of individual identity, namely the independent self and the interdependent self. It has been translated into a number of different languages in...
Article
Full-text available
With regards to the neurocognitive deficits and cognitive bias of schizophrenic disorders, it may be hypothesized that these patients suffer a deficit in recognizing helping intentions in others. To investigate help recognition, new technologies allowing to control an interaction with virtual affective agents were used with an adaptation of a previ...
Article
Full-text available
The present topic emphasizes the parallel development of concepts in social neurosciences and in other domains such as computer science, affective computing, virtual reality development, and even hardware technologies. While several researchers in neurosciences pointed out the necessity to consider naturalistic social cognition (Zaki and Ochsner, 2...
Article
Full-text available
Virtual sport coaches guide users through their physical activity and provide motivational support. Users’ motivation can rapidly decay if the movements of the virtual coach are too stereotyped. Kinematics patterns generated while performing a predefined fitness movement can elicit and help to prolong users’ interaction and interest in training. Hu...
Book
This book constitutes the refereed proceedings of the 7th International Conference on Social Robotics, ICSR 2015, held in Paris, France, in October 2015. The 70 revised full papers presented were carefully reviewed and selected from 126 submissions. The papers focus on the interaction between humans and robots and the integration of robots into our...