Article

Seeing facial motion affects auditory processing in noise.

University of Illinois, Urbana-Champaign, IL, USA, .
Attention Perception & Psychophysics (impact factor: 2.04). 10/2012; DOI:10.3758/s13414-012-0375-z
Source: PubMed

ABSTRACT Speech perception, especially in noise, may be maximized if the perceiver observes the naturally occurring visual-plus-auditory cues inherent in the production of spoken language. Evidence is conflicting, however, about which aspects of visual information mediate enhanced speech perception in noise. For this reason, we investigated the relative contributions of audibility and the type of visual cue in three experiments in young adults with normal hearing and vision. Relative to static visual cues, access to the talker's phonetic gestures in speech production, especially in noise, was associated with (a) faster response times and sensitivity for speech understanding in noise, and (b) shorter latencies and reduced amplitudes of auditory N1 event-related potentials. Dynamic chewing facial motion also decreased the N1 latency, but only meaningful linguistic motions reduced the N1 amplitude. The hypothesis that auditory-visual facilitation is distinct to properties of natural, dynamic speech gestures was partially supported.

0 0
 · 
0 Bookmarks
 · 
110 Views
Data provided are for informational purposes only. Although carefully collected, accuracy cannot be guaranteed. The impact factor represents a rough estimation of the journal's impact factor and does not reflect the actual current impact factor. Publisher conditions are provided by RoMEO. Differing provisions from the publisher's actual policy or licence agreement may be applicable.

Full-text

View
17 Downloads
Available from
21 Nov 2012

Keywords

auditory N1 event-related potentials
 
auditory-visual facilitation
 
Dynamic chewing facial motion
 
dynamic speech gestures
 
meaningful linguistic motions
 
N1 amplitude
 
N1 latency
 
normal hearing
 
occurring visual-plus-auditory cues inherent
 
relative contributions
 
speech perception
 
speech production
 
speech understanding
 
static visual cues
 
talker's phonetic gestures
 
visual cue
 
young adults