-
[show abstract]
[hide abstract]
ABSTRACT: It is widely reported that inverting a face dramatically affects its recognition. Previous studies have shown that face inversion increases the amplitude and delays the latency of the face-specific N170 component of the event-related potential (ERP) and also enhances the amplitude of the occipital P1 component (latency 100-132ms). The present study investigates whether these effects of face inversion can be modulated by visual spatial attention. Participants viewed two streams of visual stimuli, one to the left and one to the right of fixation. One stream consisted of a sequence of alphanumeric characters at 6.67Hz, and the other stream consisted of a series of upright and inverted images of faces and houses presented in randomized order. The participants' task was to attend selectively to one or the other of the streams (during different blocks) in order to detect infrequent target stimuli. ERPs elicited by inverted faces showed larger P1 amplitudes compared to upright faces, but only when the faces were attended. In contrast, the N170 amplitude was larger to inverted than to upright faces only when the faces were not attended. The N170 peak latency was delayed to inverted faces regardless of attention condition. These inversion effects were face specific, as similar effects were absent for houses. These results suggest that early stages of face-specific processing can be enhanced by attention, but when faces are not attended the onset of face-specific processing is delayed until the latency range of the N170.
Neuropsychologia 09/2012; · 3.64 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Studying the human visual system with high temporal resolution is a significant challenge due to the limitations of the available, noninvasive measurement tools. MEG and EEG provide the millisecond temporal resolution necessary for answering questions about intracortical communication involved in visual processing, but source estimation is ill-posed and unreliable when multiple; simultaneously active areas are located close together. To address this problem, we have developed a retinotopy-constrained source estimation method to calculate the time courses of activation in multiple visual areas. Source estimation was disambiguated by: (1) fixing MEG/EEG generator locations and orientations based on fMRI retinotopy and surface tessellations constructed from high-resolution MRI images; and (2) solving for many visual field locations simultaneously in MEG/EEG responses, assuming source current amplitudes to be constant or varying smoothly across the visual field. Because of these constraints on the solutions, estimated source waveforms become less sensitive to sensor noise or random errors in the specification of the retinotopic dipole models. We demonstrate the feasibility of this method and discuss future applications such as studying the timing of attentional modulation in individual visual areas.
Human Brain Mapping 07/2008; 30(4):1290-309. · 5.88 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: When two brief flashes presented in rapid succession (<100 ms apart) are paired with a single auditory stimulus, subjects often report perceiving only a single flash [Andersen, T.S., Tiippana, K., Sams, M., 2004. Factors influencing audiovisual fission and fusion illusions. Brain Res. Cogn. Brain Res. 21, 301-308; Shams, L., Iwaki, S., Chawla, A., Bhattacharya, J., 2005a. Early modulation of visual cortex by sound: an MEG study. Neurosci. Lett. 378, 76-81, Shams, L., Ma, W.J., Beierholm, U., 2005b. Sound-induced flash illusion as an optimal percept. Neuroreport 16, 1923-1927]. We used event-related potentials (ERPs) to investigate the timing and localization of the cortical processes that underlie this sound induced flash fusion, which is complementary to the sound-induced extra flash illusion that we analyzed previously [Mishra, J., Martinez, A., Sejnowski, T.J. and Hillyard, S.A., Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 27 (2007) 4120-4131]. The difference ERP that represented the cross-modal interaction between the visual (two flashes) and auditory (one sound) constituents of the bimodal stimulus revealed a positive component elicited 160-190 ms after stimulus onset, which was markedly attenuated in subjects who did not perceive the second flash. This component, previously designated as PD180 [Mishra, J., Martinez, A., Sejnowski, T.J. and Hillyard, S.A., Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 27 (2007) 4120-4131], was localized by dipole modeling to polysensory superior temporal cortex. PD180 was found to covary in amplitude across subjects with the visual evoked N1 component (148-184 ms), suggesting that inter-individual differences in perceiving the illusion are based at least in part on differences in visual processing. A trial-by-trial analysis found that the PD180 as well as a subsequent modulation in visual cortex at 228-248 ms was diminished on trials when the two flashes were perceived as one relative to trials when two flashes were correctly reported. These results suggest that the sound induced flash fusion is based on an interaction between polysensory and visual cortical areas.
Brain research 05/2008; 1242:102-15. · 2.46 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: The ventriloquist creates the illusion that his or her voice emerges from the visibly moving mouth of the puppet [1]. This well-known illusion exemplifies a basic principle of how auditory and visual information is integrated in the brain to form a unified multimodal percept. When auditory and visual stimuli occur simultaneously at different locations, the more spatially precise visual information dominates the perceived location of the multimodal event. Previous studies have examined neural interactions between spatially disparate auditory and visual stimuli [2-5], but none has found evidence for a visual influence on the auditory cortex that could be directly linked to the illusion of a shifted auditory percept. Here we utilized event-related brain potentials combined with event-related functional magnetic resonance imaging to demonstrate on a trial-by-trial basis that a precisely timed biasing of the left-right balance of auditory cortex activity by the discrepant visual input underlies the ventriloquist illusion. This cortical biasing may reflect a fundamental mechanism for integrating the auditory and visual components of environmental events, which ensures that the sounds are adaptively localized to the more reliable position provided by the visual input.
Current Biology 11/2007; 17(19):1697-703. · 9.65 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Within the visual modality, it has been shown that attention to a single visual feature of an object such as speed of motion, results in an automatic transfer of attention to other task-irrelevant features (e.g. colour). An extension of this logic might lead one to predict that such mechanisms also operate across sensory systems. But, connectivity patterns between feature modules across sensory systems are thought to be sparser to those within a given sensory system, where interareal connectivity is extensive. It is not clear that transfer of attention between sensory systems will operate as it does within a sensory system. Using high-density electrical mapping of the event-related potential (ERP) in humans, we tested whether attending to objects in one sensory modality resulted in the preferential processing of that object's features within another task-irrelevant sensory modality. Clear evidence for cross-sensory attention effects was seen, such that for multisensory stimuli responses to ignored task-irrelevant information in the auditory and visual domains were selectively enhanced when they were features of the explicitly attended object presented in the attended sensory modality. We conclude that attending to an object within one sensory modality results in coactivation of that object's representations in ignored sensory modalities. The data further suggest that transfer of attention from visual-to-auditory features operates in a fundamentally different manner than transfer from auditory-to-visual features, and indicate that visual-object representations have a greater influence on their auditory counterparts than vice-versa. These data are discussed in terms of 'priming' vs. 'spreading' accounts of attentional transfer.
European Journal of Neuroscience 08/2007; 26(2):499-509. · 3.63 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: When a single flash of light is presented interposed between two brief auditory stimuli separated by 60-100 ms, subjects typically report perceiving two flashes (Shams et al., 2000, 2002). We investigated the timing and localization of the cortical processes that underlie this illusory flash effect in 34 subjects by means of 64-channel recordings of event-related potentials (ERPs). A difference ERP calculated to isolate neural activity associated with the illusory second flash revealed an early modulation of visual cortex activity at 30-60 ms after the second sound, which was larger in amplitude in subjects who saw the illusory flash more frequently. These subjects also showed this early modulation in response to other combinations of auditory and visual stimuli, thus pointing to consistent individual differences in the neural connectivity that underlies cross-modal integration. The overall pattern of cortical activity associated with the cross-modally induced illusory flash, however, differed markedly from that evoked by a real second flash. A trial-by-trial analysis showed that short-latency ERP activity localized to auditory cortex and polymodal cortex of the temporal lobe, concurrent with gamma bursts in visual cortex, were associated with perception of the double-flash illusion. These results provide evidence that perception of the illusory second flash is based on a very rapid dynamic interplay between auditory and visual cortical areas that is triggered by the second sound.
Journal of Neuroscience 05/2007; 27(15):4120-31. · 7.11 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Visual processing deficits are an integral component of schizophrenia and are sensitive predictors of schizophrenic decompensation in healthy adults. The primate visual system consists of discrete subcortical magnocellular and parvocellular pathways, which project preferentially to dorsal and ventral cortical streams. Subcortical systems show differential stimulus sensitivity, while cortical systems, in turn, can be differentiated using surface potential analysis. The present study examined contributions of subcortical dysfunction to cortical processing deficits using high-density event-related potentials. Event-related potentials were recorded to stimuli biased towards the magnocellular system using low-contrast isolated checks in Experiment 1 and towards the magnocellular or parvocellular system using low versus high spatial frequency (HSF) sinusoidal gratings, respectively, in Experiment 2. The sample consisted of 23 patients with schizophrenia or schizoaffective disorder and 19 non-psychiatric volunteers of similar age. In Experiment 1, a large decrease in the P1 component of the visual event-related potential in response to magnocellular-biased isolated check stimuli was seen in patients compared with controls (F = 13.2, P = 0.001). Patients also showed decreased slope of the contrast response function over the magnocellular-selective contrast range compared with controls (t = 9.2, P = 0.04) indicating decreased signal amplification. In Experiment 2, C1 (F = 8.5, P = 0.007), P1 (F = 33.1, P < 0.001) and N1 (F = 60.8, P < 0.001) were reduced in amplitude to magnocellular-biased low spatial frequency (LSF) stimuli in patients with schizophrenia, but were intact to parvocellular-biased HSF stimuli, regardless of generator location. Source waveforms derived from inverse dipole modelling showed reduced P1 in Experiment 1 and reduced C1, P1 and N1 to LSF stimuli in Experiment 2, consistent with surface waveforms. These results indicate pervasive magnocellular dysfunction at the subcortical level that leads to secondary impairment in activation of cortical visual structures within dorsal and ventral stream visual pathways. Our finding of early visual dysfunction is consistent with and explanatory of classic literature showing subjective complaints of visual distortions and is consistent with early visual processing deficits reported in schizophrenia. Although deficits in visual processing have frequently been construed as resulting from failures of top-down processing, the present findings argue strongly for bottom-up rather than top-down dysfunction at least within the early visual pathway. Deficits in magnocellular processing in this task may reflect more general impairments in neuronal systems functioning, such as deficits in non-linear amplification and may thus represent an organizing principle for predicting neurocognitive dysfunction in schizophrenia.
Brain 03/2007; 130(Pt 2):417-30. · 9.46 Impact Factor
-
01/2006; , ISBN: 9780470018866
-
[show abstract]
[hide abstract]
ABSTRACT: Electrophysiological studies have revealed a pre-attentive change-detection system in the auditory modality. This system emits a signal termed the mismatch negativity (MMN) when any detectable change in a regular pattern of auditory stimulation occurs. The precise intracranial sources underlying MMN generation, and in particular whether these vary as a function of the acoustic feature that changes, is a matter of some debate. Using functional magnetic resonance imaging, we show that anatomically distinct networks of auditory cortices are activated as a function of the deviating acoustic feature--in this case, tone frequency and tone duration--strongly supporting the hypothesis that MMN generators in auditory cortex are feature dependent. We also detail regions of the frontal and parietal cortices activated by change-detection processes. These regions also show feature dependence and we hypothesize that they reflect recruitment of attention-switching mechanisms.
Cerebral Cortex 06/2005; 15(5):545-51. · 6.54 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: This study examined the cognitive and neural development of attention switching using a simple forced-choice attention task and functional magnetic resonance imaging Fourteen children and adults made discriminations among stimuli based on either shape or color. Performance on these trials was compared to performance during blocked trials requiring all color or all shape discriminations. Magnetic resonance echo planar images were acquired during performance of the task. Both children and adults showed robust bilateral activity of the caudate nucleus when switching attention between color and shape discriminations that correlated negatively with mean response latency on these trials. However, neither switching costs nor caudate activity correlated with age, suggesting early development of the underlying neural circuitry involved in switching between salient stimulus sets. Overall, children and adults differed in performance and patterns of brain activity on the task, with adults responding more accurately and faster than children, and recruiting more prefrontal and parietal regions. These results suggest an important role of subcortical regions (i.e. caudate nucleus) in non-cued attention switching, with increasing recruitment of cortical regions with age.
Developmental Science 12/2004; 7(5):534-42. · 3.89 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: This study examined the cognitive and neural development of attention switching using a simple forced-choice attention task and functional magnetic resonance imaging. Fourteen children and adults made discriminations among stimuli based on either shape or color. Performance on these trials was compared to performance during blocked trials requiring all color or all shape discriminations. Magnetic resonance echo planar images were acquired during performance of the task. Both children and adults showed robust bilateral activity of the caudate nucleus when switching attention between color and shape discriminations that correlated negatively with mean response latency on these trials. However, neither switching costs nor caudate activity correlated with age, suggesting early development of the underlying neural circuitry involved in switching between salient stimulus sets. Overall, children and adults differed in performance and patterns of brain activity on the task, with adults responding more accurately and faster than children, and recruiting more prefrontal and parietal regions. These results suggest an important role of subcortical regions (i.e. caudate nucleus) in non-cued attention switching, with increasing recruitment of cortical regions with age.
Developmental Science 10/2004; 7(5):534 - 542. · 3.89 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Using high-field (3 Tesla) functional magnetic resonance imaging (fMRI), we demonstrate that auditory and somatosensory inputs converge in a subregion of human auditory cortex along the superior temporal gyrus. Further, simultaneous stimulation in both sensory modalities resulted in activity exceeding that predicted by summing the responses to the unisensory inputs, thereby showing multisensory integration in this convergence region. Recently, intracranial recordings in macaque monkeys have shown similar auditory-somatosensory convergence in a subregion of auditory cortex directly caudomedial to primary auditory cortex (area CM). The multisensory region identified in the present investigation may be the human homologue of CM. Our finding of auditory-somatosensory convergence in early auditory cortices contributes to mounting evidence for multisensory integration early in the cortical processing hierarchy, in brain regions that were previously assumed to be unisensory.
Journal of Neurophysiology 08/2002; 88(1):540-3. · 3.32 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: Schizophrenia subjects demonstrate difficulties on tasks requiring saccadic inhibition, despite normal refixation saccade performance. Saccadic inhibition is ostensibly mediated via prefrontal cortex and associated cortical/subcortical circuitry. The current study tests hypotheses about the neural substrates of normal and abnormal saccadic performance among subjects with schizophrenia.
Using functional magnetic resonance imaging, blood oxygenation level-dependent (BOLD) data were recorded while 13 normal and 14 schizophrenia subjects were engaged in refixation and antisaccade tasks.
Schizophrenia subjects did not demonstrate the increased prefrontal cortex BOLD contrast during antisaccade performance that was apparent in the normal subjects. Schizophrenia subjects did, however, demonstrate normal BOLD contrast associated with refixation saccade performance in the frontal and supplementary eye fields, and posterior parietal cortex.
Results from the current study support hypotheses of dysfunctional prefrontal cortex circuitry among schizophrenia subjects. Furthermore, this abnormality existed despite normal BOLD contrast observed during refixation saccade generation in the schizophrenia group.
Biological Psychiatry 03/2002; 51(3):216-23. · 8.28 Impact Factor
-
[show abstract]
[hide abstract]
ABSTRACT: For many years, researchers investigating the brain bases of bilingualism have concentrated on two basic questions. The first concerns the nature of language representation. That is, are a bilinguals' two languages represented in distinct or overlapping areas of the brain. The second basic question in the neuropsychology of bilingualism concerns the neural correlates of language switching, that is, the areas that are active when bilinguals switch from one language to the other. Performance between single-language and dual-language picture naming was compared in a group of six Spanish–English bilinguals using behavioral measures and functional magnetic resonance imaging. Participants showed slower reaction times and increased activation in the dorsolateral prefrontal cortex in the mixed language condition relative to single language condition. There was no evidence that each language was represented in different areas of the brain. Results are consistent with the view that language switching is a part of a general executive attentional system and that languages are represented in overlapping areas of the brain in early bilinguals.
Brain and Language.
