-
[show abstract]
[hide abstract]
ABSTRACT: Our ability to selectively attend to one auditory signal amid competing input streams, epitomized by the "Cocktail Party" problem, continues to stimulate research from various approaches. How this demanding perceptual feat is achieved from a neural systems perspective remains unclear and controversial. It is well established that neural responses to attended stimuli are enhanced compared with responses to ignored ones, but responses to ignored stimuli are nonetheless highly significant, leading to interference in performance. We investigated whether congruent visual input of an attended speaker enhances cortical selectivity in auditory cortex, leading to diminished representation of ignored stimuli. We recorded magnetoencephalographic signals from human participants as they attended to segments of natural continuous speech. Using two complementary methods of quantifying the neural response to speech, we found that viewing a speaker's face enhances the capacity of auditory cortex to track the temporal speech envelope of that speaker. This mechanism was most effective in a Cocktail Party setting, promoting preferential tracking of the attended speaker, whereas without visual input no significant attentional modulation was observed. These neurophysiological results underscore the importance of visual input in resolving perceptual ambiguity in a noisy environment. Since visual cues in speech precede the associated auditory signals, they likely serve a predictive role in facilitating auditory processing of speech, perhaps by directing attentional resources to appropriate points in time when to-be-attended acoustic input is expected to arrive.
Journal of Neuroscience 01/2013; 33(4):1417-26. · 7.11 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: The human capacity for processing speech is remarkable, especially given that information in speech unfolds over multiple time scales concurrently. Similarly notable is our ability to filter out of extraneous sounds and focus our attention on one conversation, epitomized by the 'Cocktail Party' effect. Yet, the neural mechanisms underlying on-line speech decoding and attentional stream selection are not well understood. We review findings from behavioral and neurophysiological investigations that underscore the importance of the temporal structure of speech for achieving these perceptual feats. We discuss the hypothesis that entrainment of ambient neuronal oscillations to speech's temporal structure, across multiple time-scales, serves to facilitate its decoding and underlies the selection of an attended speech stream over other competing input. In this regard, speech decoding and attentional stream selection are examples of 'Active Sensing', emphasizing an interaction between proactive and predictive top-down modulation of neuronal dynamics and bottom-up sensory input.
Brain and Language 01/2012; 122(3):151-61. · 3.12 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: In a previous study of visual-spatial attention, Martinez et al. (2007) replicated the well-known finding that stimuli at attended locations elicit enlarged early components in the averaged event-related potential (ERP), which were localized to extrastriate visual cortex. The mechanisms that underlie these attention-related ERP modulations in the latency range of 80-200 ms, however, remain unclear. The main question is whether attention produces increased ERP amplitudes in time-domain averages by augmenting stimulus-triggered neural activity, or alternatively, by increasing the phase-locking of ongoing EEG oscillations to the attended stimuli. We compared these alternative mechanisms using Morlet wavelet decompositions of event-related EEG changes. By analyzing single-trial spectral amplitudes in the theta (4-8 Hz) and alpha (8-12 Hz) bands, which were the dominant frequencies of the early ERP components, it was found that stimuli at attended locations elicited enhanced neural responses in the theta band in the P1 (88-120 ms) and N1 (148-184 ms) latency ranges that were additive with the ongoing EEG. In the alpha band there was evidence for both increased additive neural activity and increased phase-synchronization of the EEG following attended stimuli, but systematic correlations between pre- and post-stimulus alpha activity were more consistent with an additive mechanism. These findings provide the strongest evidence to date in humans that short-latency neural activity elicited by stimuli within the spotlight of spatial attention is boosted or amplified at early stages of processing in extrastriate visual cortex.
NeuroImage 01/2012; 59(2):1968-78. · 5.89 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Multielectrode neurophysiological recording and functional brain imaging produce massive quantities of data. Multivariate time series analysis provides the basic framework for analyzing the patterns of neural interactions in these data. Neural interactions are directional. Being able to assess the directionality of neuronal interactions is thus a highly desired capability for understanding the cooperative nature of neural computation. Research over the last few years has identified Granger causality as a promising technique to furnish this capability. In this paper, we first introduce the concept of Granger causality and then present results from the application of this technique to multichannel local field potential data from an awake-behaving monkey.
Conference proceedings: ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference 08/2011; 2011:5916-8.
