Multisensory Integration: Frequency Tuning of Audio-Tactile Integration

Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, 138th Street and Convent Avenue, NAC Building-Room 7/202, New York, NY 10031, USA.
Current biology: CB (Impact Factor: 9.92). 06/2009; 19(9):R373-5. DOI: 10.1016/j.cub.2009.03.029
Source: PubMed

ABSTRACT Multisensory information can be crucial, yet in many circumstances we have little, if any, awareness of the effects of multisensory inputs on what appear to be entirely unisensory perceptions. A recent study shows robust effects of auditory input on tactile frequency discriminations and that this auditory cross-sensory interference has specific tuning.

Download full-text


Available from: John J Foxe, Jul 29, 2015
  • Source
    • "Research has also shown that the neural substrates of both the auditory and tactile systems are shared at a much lower level than previously understood [5] [6]. For our experiments, we have chosen to focus on the cumulative effects of both vibrotactile feedback applied in tandem with an auditory stimulus. "
    NIME 2015; 01/2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Audition and touch endow spectral processing abilities allowing texture recognition and discrimination. Rat whiskers sensory system exhibits, as the cochlea, resonance property decomposing the signal over frequencies. Moreover, there exists strong psychophysical and biological interactions between auditory and somatosensory corteces concerning texture analysis. Inspired by these similarities, this paper introduce a ”supramodal” model allowing both vibrissa tactile and auditory texture recognition. Two gammatone based resonant filterbanks are used for cochlea and whiskers array modeling. Each filterbank is then linked to a feature extraction algorithm, inspired by data recorded in the rats barrel cortex, and finally to a multilayer perceptron. Results clearly show the ability of the model for texture recognition in both auditory and tactile tuning. Moreover, recent studies suggest that this resonance property plays a role in texture discrimination. Experiments presented here provide elements in the direction of this resonance hypothesis.
    From Animals to Animats 11, 11th International Conference on Simulation of Adaptive Behavior, SAB 2010, Paris - Clos Lucé, France, August 25-28, 2010. Proceedings; 01/2010
  • [Show abstract] [Hide abstract]
    ABSTRACT: Reacting to a touch on the skin often requires the remapping of the initial somatotopicaly-based representation of the stimulus into an external frame of reference that incorporates information about current body posture. A growing number of studies support the view that tactile encoding in external coordinates occurs automatically. However, it remains unclear whether or not spatial task demands are required to trigger this remapping process, casting some doubt on the automaticity hypothesis. We designed three experiments in which space was progressively removed, and tactile remapping across different body postures was gauged through the modulation of visual performance. We used speeded two-alternative forced-choice colour judgements (i.e., a nonspatial selection feature) about visual targets presented laterally following a spatially noninformative (congruent or incongruent) tactile cue on one hand. In experiment 1, using footpedal responses, visual performance was modulated according to the external location of the tactile cue, regardless of hand posture (either crossed or uncrossed). In experiment 2, using verbal responses, external cueing was also observed (albeit in an attenuated fashion) despite the removal of space from response set. In experiment 3 we removed spatial uncertainty about cue and target locations by presenting tactile cues and visual targets from fixed positions, yet spatial congruency still exerted some modulation on visual performance, again independent of hand posture. These results demonstrate that engaging in spatial tasks is not a prerequisite for triggering tactile remapping, and are thus in agreement with previous accounts suggesting that touch is automatically remapped.
    European Journal of Neuroscience 05/2010; 31(10):1858-67. DOI:10.1111/j.1460-9568.2010.07233.x · 3.67 Impact Factor
Show more