Article

Mapping and manipulating facial expression.

School of Computing Sciences, University of East Anglia, Norwich, UK.
Language and Speech (impact factor: 1.03). 02/2009; 52(Pt 2-3):369-86. pp.369-86
Source: PubMed

ABSTRACT Nonverbal visual cues accompany speech to supplement the meaning of spoken words, signify emotional state, indicate position in discourse, and provide back-channel feedback. This visual information includes head movements, facial expressions and body gestures. In this article we describe techniques for manipulating both verbal and nonverbal facial gestures in video sequences of people engaged in conversation. We are developing a system for use in psychological experiments, where the effects of manipulating individual components of nonverbal visual behavior during live face-to-face conversation can be studied. In particular, the techniques we describe operate in real-time at video frame-rate and the manipulation can be applied so both participants in a conversation are kept blind to the experimental conditions.

0 0
 · 
0 Bookmarks
 · 
42 Views
  • Source
    Conference Proceeding: Real-time avatar animation from a single image
    Jason M. Saragih, Simon Lucey, Jeffrey F. Cohn
    [show abstract] [hide abstract]
    ABSTRACT: A real time facial puppetry system is presented. Compared with existing systems, the proposed method requires no special hardware, runs in real time (23 frames-per-second), and requires only a single image of the avatar and user. The user's facial expression is captured through a real-time 3D non-rigid tracking system. Expression transfer is achieved by combining a generic expression model with synthetically generated examples that better capture person specific characteristics. Performance of the system is evaluated on avatars of real people as well as masks and cartoon characters.
    Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on; 04/2011
Data provided are for informational purposes only. Although carefully collected, accuracy cannot be guaranteed. The impact factor represents a rough estimation of the journal's impact factor and does not reflect the actual current impact factor. Publisher conditions are provided by RoMEO. Differing provisions from the publisher's actual policy or licence agreement may be applicable.

Keywords

back-channel feedback
 
blind
 
body gestures
 
emotional state
 
face-to-face conversation
 
facial expressions
 
head movements
 
nonverbal facial gestures
 
nonverbal visual behavior
 
Nonverbal visual cues
 
techniques
 
video frame-rate
 
video sequences
 
visual information