Stereopsis from contrast envelopes

Department of Computing and Information Science, Queens University, Kingston, K7L 3N6, Canada
Vision Research (Impact Factor: 2.38). 08/1999; 39(14):2313-2324. DOI: 10.1016/S0042-6989(98)00271-5
Source: CiteSeer

ABSTRACT We report two experiments concerning the site of the principal nonlinearity in second-order stereopsis. The first exploits the asymmetry in perceiving transparency with second-order stimuli found by Langley et al. (1998) (Proceedings of the Royal Society of London B, 265, 1837–1845) i.e. the product of a positive-valued contrast envelope and a mean-zero carrier grating can be seen transparently only when the disparities are consistent with the envelope appearing in front of the carrier. We measured the energy at the envelope frequencies that must be added in order to negate this asymmetry. We report that this amplitude can be predicted from the envelope sidebands and not from the magnitude of compressive pre-cortical nonlinearities measured by other researchers. In the second experiment, contrast threshold elevations were measured for the discrimination of envelope disparities following adaptation to sinusoidal gratings. It is reported that perception of the envelope’s depth was affected most when the adapting grating was similar (in orientation and frequency) to the carrier, rather than to the contrast envelope. These results suggest that the principal nonlinearity in second-order stereopsis is cortical, occurring after orientation- and frequency-selective linear filtering.

Download full-text


Available from: Keith Langley, Jun 22, 2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Vergence eye movements were elicited in human subjects by applying disparities to square-wave gratings lacking the fundamental ("missing fundamental", mf). Using a dichoptic arrangement, subjects viewed gratings that were identical at the two eyes except for a phase difference of 1/4 wavelength so that, based on the nearest-neighbor matches, the features and the 4n+1 harmonics (5th, 9th, etc.) all had binocular disparities of one sign, whereas the 4n-1 harmonics (3rd, 7th, etc.) all had disparities of the opposite sign. Further, the amplitude of the ith harmonic was proportional to 1/i. Using the electromagnetic search coil technique to record the positions of both eyes indicated that the earliest vergence eye movements elicited by these disparity stimuli had ultra-short latencies (minimum, <65 ms) and were always in the direction of the most prominent harmonic, the 3rd, but their magnitudes fell short of those elicited when the same disparities were applied to pure sinusoids whose spatial frequency and contrast matched those of the 3rd harmonic. This shortfall was evident in both the horizontal vergence responses recorded with vertical grating stimuli and the vertical vergence responses recorded with horizontal grating stimuli. When the next most prominent harmonic, the 5th, was removed from the mf stimulus (creating the "mf-5" stimulus) the vertical vergence responses showed almost no shortfall-indicating that it had been almost entirely due to that 5th harmonic-but the horizontal vergence responses still showed a small shortfall, at least with higher contrast stimuli. This small shortfall might represent a very minor contribution from higher harmonics and/or distortion products and/or a feature-based mechanism. We conclude that the earliest disparity vergence responses-especially vertical-were strongly dependent on the major Fourier components of the binocular images, consistent with early spatial filtering of the monocular visual inputs prior to their binocular combination as in the disparity-energy model of complex cells in striate cortex [Ohzawa, I., DeAngelis, G. C., & Freeman, R. D. (1990). Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. Science, 249, 1037-1041].
    Vision Research 11/2006; 46(21):3723-40. DOI:10.1016/j.visres.2006.04.020 · 2.38 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The left and right eyes receive subtly different images from a visual scene. Binocular disparities of retinal image locations are correlated with variation in the depth of objects in the scene and make stereoscopic depth perception possible. Disparity stereoscopically specifies a stimulus; changing the stimulus in a way that conserves its disparity leaves the stimulus stereoscopically unchanged. Therefore, a person's ability to use stereo to see the depth separating any two objects should depend only on the disparities of the objects, which in turn depend on where the objects are, not what they are. However, I find that the disparity difference between two stimuli by itself predicts neither stereoacuity nor perceived depth. Human stereo vision is shown here to be most sensitive at detecting the relative depth of two gratings when they are parallel. Rotating one grating by as little as 10 degrees lowers sensitivity. The rotation can make a perceptible depth separation invisible, although it changes neither the relative nor absolute disparities of the gratings, only their relative orientations. The effect of relative orientation is not confined to stimuli that, like gratings, vary along one dimension or to stimuli perceived to have a dominant orientation. Rather, it is the relative orientation of the one-dimensional components of stimuli, even broadband stimuli, that matters. This limit on stereoscopic depth perception appears to be intrinsic to the visual system's computation of disparity; by taking place within orientation bands, the computation renders the coding of disparity inseparable from the coding of orientation.
    The Journal of Neuroscience : The Official Journal of the Society for Neuroscience 10/2006; 26(36):9098-106. DOI:10.1523/JNEUROSCI.1100-06.2006 · 6.75 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Stereo plaid stimuli were created to investigate whether depth perception is determined by an intersection of constraints (IOC) or vector average (VA) operation on the Fourier components, or by the second-order (non-Fourier) feature in a pattern. We first created stereo plaid stimuli where IOC predicted vertical disparity, VA predicted positive diagonal disparity and the second-order feature predicted negative diagonal disparity. In a depth discrimination task, observers indicated whether they perceived the pattern as 'near' or 'far' relative to a zero-disparity aperture. Observers' perception was consistent with the disparity predicted by VA, indicating its dominance over IOC and the second-order feature in this condition. Additional stimuli in which VA predicted vertical disparity were created to investigate whether VA would dominate perception when it was a less reliable cue. In this case, observers' performance was consistent with disparity predicted by IOC or the second-order feature, not VA. Finally, in order to determine whether the second-order feature contributes to depth perception, stimuli were created where IOC and VA predicted positive horizontal disparity while the second-order feature predicted negative horizontal disparity. When the component gratings were oriented near horizontal (+/-83 degrees from vertical), depth perception corresponded to that predicted by the second-order feature. However, as the components moved away from horizontal (+/-75 degrees and +/-65 degrees from vertical), depth perception was increasingly likely to be predicted by an IOC or VA operation. These experiments suggest that the visual system does not rely exclusively on a single method for computing pattern disparity. Instead, it favours the most reliable method for a given condition.
    Vision Research 02/2005; 45(1):75-89. DOI:10.1016/j.visres.2004.07.028 · 2.38 Impact Factor