Sound-contingent visual motion aftereffect

Department of Psychology, Rikkyo University, Niiza-shi, Saitama, 352-8558 Japan.
BMC Neuroscience (Impact Factor: 2.67). 05/2011; 12(1):44. DOI: 10.1186/1471-2202-12-44
Source: PubMed


After a prolonged exposure to a paired presentation of different types of signals (e.g., color and motion), one of the signals (color) becomes a driver for the other signal (motion). This phenomenon, which is known as contingent motion aftereffect, indicates that the brain can establish new neural representations even in the adult's brain. However, contingent motion aftereffect has been reported only in visual or auditory domain. Here, we demonstrate that a visual motion aftereffect can be contingent on a specific sound.
Dynamic random dots moving in an alternating right or left direction were presented to the participants. Each direction of motion was accompanied by an auditory tone of a unique and specific frequency. After a 3-minutes exposure, the tones began to exert marked influence on the visual motion perception, and the percentage of dots required to trigger motion perception systematically changed depending on the tones. Furthermore, this effect lasted for at least 2 days.
These results indicate that a new neural representation can be rapidly established between auditory and visual modalities.

Download full-text


Available from: Souta Hidaka, Oct 03, 2015
15 Reads
  • Source
    • "However, our point here was not to replicate Haijiang et al's findings but rather was attempted to test whether olfactory cues could influence visual motion processing in general. Similar effects have also been observed in audiovisual interaction studies333435. It was reported that the association between sound and visual motion was easily acquired within a short period of time and sound was able to induce illusory visual motion perception for both static33 and moving visual objects3435. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Senses of smells are often accompanied by simultaneous visual sensations. Previous studies have documented enhanced olfactory performance with concurrent presence of congruent color- or shape- related visual cues, and facilitated visual object perception when congruent smells are simultaneously present. These visual object-olfaction interactions suggest the existences of couplings between the olfactory pathway and the visual ventral processing stream. However, it is not known if olfaction can modulate visual motion perception, a function that is related to the visual dorsal stream. We tested this possibility by examining the influence of olfactory cues on the perceptions of ambiguous visual motion signals. We showed that, after introducing an association between motion directions and olfactory cues, olfaction could indeed bias ambiguous visual motion perceptions. Our result that olfaction modulates visual motion processing adds to the current knowledge of cross-modal interactions and implies a possible functional linkage between the olfactory system and the visual dorsal pathway.
    Scientific Reports 07/2014; 4:5796. DOI:10.1038/srep05796 · 5.58 Impact Factor
  • Source
    • "In line with these findings, we might consider that decisional/response biasing effects of the exposures would not fully explain our current results. Rather, together with previous findings showing the selectivity of the contingent effects for the visual field (Teramoto et al. 2010; Hidaka et al. 2011), eye (Kobayashi et al. 2012a), sound frequency (Kobayashi et al. 2012b), and ear (Kobayashi et al. 2012b), the current observation suggests that the brain can establish the associations in relatively early perceptual processing stages of the auditory and visual systems. Contingent aftereffects have been reported in visual (e.g., McCollough 1965; Stromeyer and Mansfield 1970; Favreau et al. 1972; Held and Shattuck 1971; Mayhew and Anstis 1972) and auditory (Dong et al. 1999) domains. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Visual motion aftereffects can occur contingent on arbitrary sounds. Two circles, placed side by side, were alternately presented, and the onsets were accompanied by tone bursts of high and low frequencies, respectively. After a few minutes of exposure to the visual apparent motion with the tones, a circle blinking at a fixed location was perceived as a lateral motion in the same direction as the previously exposed apparent motion (Teramoto et al. in PLoS One 5:e12255, 2010). In the present study, we attempted to reverse this contingency (pitch aftereffects contingent on visual information). Results showed that after prolonged exposure to the audio-visual stimuli, the apparent visual motion systematically affected the perceived pitch of the auditory stimuli. When the leftward apparent visual motion was paired with the high-low-frequency sequence during the adaptation phase, a test tone sequence was more frequently perceived as a high-low-pitch sequence when the leftward apparent visual motion was presented and vice versa. Furthermore, the effect was specific for the exposed visual field and did not transfer to the other side, thus ruling out an explanation in terms of simple response bias. These results suggest that new audiovisual associations can be established within a short time, and visual information processing and auditory processing can mutually influence each other.
    Experimental Brain Research 06/2013; 229(1). DOI:10.1007/s00221-013-3596-z · 2.04 Impact Factor
  • Source
    • "A flashing, high contrast bar presented at a fixed location in the periphery of the visual field is perceived as shifting in lateral motion when synchronized with an alternating left and right sound. Moreover, a measurable aftereffect can be obtained by this induced motion [21]. One interesting aspect of this illusion, relevant for the current study, is that sound causes a visual-spatial mis-localization, whereas most previous studies of audio-visual illusions have used vision to bias auditory location or audition to bias visual timing [22], [23], [24]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The question of whether perceptual illusions influence eye movements is critical for the long-standing debate regarding the separation between action and perception. To test the role of auditory context on a visual illusion and on eye movements, we took advantage of the fact that the presence of an auditory cue can successfully modulate illusory motion perception of an otherwise static flickering object (sound-induced visual motion effect). We found that illusory motion perception modulated by an auditory context consistently affected saccadic eye movements. Specifically, the landing positions of saccades performed towards flickering static bars in the periphery were biased in the direction of illusory motion. Moreover, the magnitude of this bias was strongly correlated with the effect size of the perceptual illusion. These results show that both an audio-visual and a purely visual illusion can significantly affect visuo-motor behavior. Our findings are consistent with arguments for a tight link between perception and action in localization tasks.
    PLoS ONE 04/2013; 8(4):e62131. DOI:10.1371/journal.pone.0062131 · 3.23 Impact Factor
Show more