[Show abstract][Hide abstract] ABSTRACT: This work examines the production side of social affects in Mandarin Chinese, with the aim of extracting the more prominent patterns of acoustical variations. Results are then compared to previous perception data obtained on the same expressions. The F0, intensity and duration characteristics of 76 utterances conveying 19 prosodic attitudes are statistically examined in this study. All attitudes are regrouped into 5 clusters according to their prosodic features. The result of the statistical analysis shows that the prominent differentiation between clusters is mostly related to F0 and duration parameters; some similarities are noted between the clustering of attitudes from acoustic features and from perceptual confusions obtained in previous experiments; inside each cluster, some attitudes show typical characteristics in F0 and duration.
[Show abstract][Hide abstract] ABSTRACT: The aim of this preliminary study of feasibility is to give a glance at interactions in a Smart Home prototype between the elderly and a companion robot that is having some socioaffective language primitives as the only vector of communication. Through a Wizard of Oz platform (EmOz), a robot is introduced as an intermediary between the technological environment and some elderly who have to give vocal commands to the robot to control the Smart Home. The robot vocal productions increases progressively by adding prosodic levels: (1) no speech, (2) pure prosodic mouth noises supposed to be the "glue's" tools, (3) lexicons with supposed "glue" prosody and (4) subject's commands imitations with supposed "glue" prosody. The elderly subjects' speech behaviors confirm the hypothesis that the socio-affective "glue" effect increase towards the prosodic levels, especially for socio-isolated people.
[Show abstract][Hide abstract] ABSTRACT: This work presents a methodology used to collect some spontaneous social affect corpus and preliminary prosodic analysis of certainty and uncertainty in Brazilian Portuguese. The corpus was collected using a Wizard of Oz method (through EmOz platform). The scenario to induce certainty and uncertainty is based on the situation of a job interview, where a companion robot (Emox) is used as a trainer. The subjects were convinced to benefit from a free teaching of this revolutionary method to train to job interview. In this scenario the linguistic expressions are partially controlled, in order to focus the certainty/uncertainty expression mainly on paraphrasing and prosody. Data were preliminarily analyzed for audiovisual prosody: videos analysis were made regarding eyebrows, eyes, mouth and face/head movements, while audio analysis were made about acoustic prosody parameters of fundamental frequency and duration. The first results show that using EmOz within such a scenario is an efficient way to induct spontaneous but comparable speech production. Prosodic results show that fundamental frequency and duration measurements, as well as eyebrows, eyes, mouth and face/head movements are differently used in certainty and in uncertainty production in Brazilian Portuguese.
[Show abstract][Hide abstract] ABSTRACT: Social affects play an important role in the face-to-face interaction and are implied in the realization of speech acts. The prosody is a main vector of social affects and its cross-language variability is a challenge for language description as well as for foreign language teaching. The present paper aims at examining the influences of tones on the perception of 19 prosodic social affects of Mandarin Chinese by French and Vietnamese subjects. A corpus of attitudinal speech was designed with a variation of tones values and location. The test results show that most social affects were globally recognized over chance by the two groups of foreign-language subjects. For French subjects, "contempt", "irony" and "confidence", and "irony" for Vietnamese, were not identified – independently of tones distribution. A significant effect of tones for the two groups was found, with a higher magnitude for French than for Vietnamese. Moreover, a significant attitude & tone interaction is observed for both languages.