Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex

Department of Neuroscience and Ophthalmology, Children's Hospital Boston, Harvard Medical School, Boston, MA 02115, USA.
Neuron (Impact Factor: 15.98). 05/2009; 62(2):281-90. DOI: 10.1016/j.neuron.2009.02.025
Source: PubMed

ABSTRACT The difficulty of visual recognition stems from the need to achieve high selectivity while maintaining robustness to object transformations within hundreds of milliseconds. Theories of visual recognition differ in whether the neuronal circuits invoke recurrent feedback connections or not. The timing of neurophysiological responses in visual cortex plays a key role in distinguishing between bottom-up and top-down theories. Here, we quantified at millisecond resolution the amount of visual information conveyed by intracranial field potentials from 912 electrodes in 11 human subjects. We could decode object category information from human visual cortex in single trials as early as 100 ms poststimulus. Decoding performance was robust to depth rotation and scale changes. The results suggest that physiological activity in the temporal lobe can account for key properties of visual recognition. The fast decoding in single trials is compatible with feedforward theories and provides strong constraints for computational models of human vision.

Download full-text


Available from: Gabriel Kreiman, Jul 02, 2015
1 Follower
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Generally more target features leads to poor search guidance. In this paper we identify the few important features for target image set by considering the role of color and shape in expert object recognition. Generally more un-important target features leads to poor search guidance and there by VWM(Visual Working Memory) load will be increased and few important features leads to good search guidance and there by VWM load will be decreased. We adopted the approach CDA (Contra lateral Delay Activity) to estimate VWM load there by reducing mean time and calculating CDA magnitude to estimate the relevance for search objects. The smaller the CDA value, greater the search guidance and lesser the VWM load and vice-versa. Hence, we prove that few important features lead to good search guidance. We are introducing the role of color and shape features in expert object recognition to train the system by combining CDA approach.
    IEEE International Conference on Contemporary Computing and Informatics, Mysore, Karnataka, INDIA; 11/2014
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Recordings from individual neurons in patients who are implanted with depth electrodes for clinical reasons have opened the possibility to narrow down the gap between neurophysiological studies in animals and non-invasive (e.g. functional magnetic resonance imaging, electroencephalogram, magnetoencephalography) investigations in humans. Here we provide a description of the main procedures for electrode implantation and recordings, the experimental paradigms used and the main steps for processing the data. We also present key characteristics of the so-called ‘concept cells’, neurons in the human medial temporal lobe with selective and invariant responses that represent the meaning of the stimulus, and discuss their proposed role in declarative memory. Finally, we present novel results dealing with the stability of the representation given by these neurons, by studying the effect of stimulus repetition in the strength of the responses. In particular, we show that, after an initial decay, the response strength reaches an asymptotic value after approximately 15 presentations that remains above baseline for the whole duration of the experiment.
    Journal of Anatomy 08/2014; DOI:10.1111/joa.12228 · 2.23 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: knife and apple remind us on peeling the apple or cutting it. Mnemonic representations of object-related actions (action codes) evoked by the sight of an object may constrain and hence facilitate recognition of unrolling actions. The present fMRI study investigated if and how action codes influence brain activation during action observation. The average number of action codes (NAC) of 51 sets of objects was rated by a group of n = 24 participants. In an fMRI study, different volunteers were asked to recognize actions performed with the same objects presented in short videos. To disentangle areas reflecting the storage of action codes from those exploiting them, we showed object-compatible and object-incompatible (pantomime) actions. Areas storing action codes were considered to positively co-vary with NAC in both object-compatible and object-incompatible action; due to its role in tool-related tasks, we here hypothesized left anterior inferior parietal cortex (aIPL). In contrast, areas exploiting action codes were expected to show this correlation only in object-compatible but not incompatible action, as only object-compatible actions match one of the active action codes. For this interaction, we hypothesized ventrolateral premotor cortex (PMv) to join aIPL due to its role in biasing competition in IPL. We found left anterior intraparietal sulcus (IPS) and left posterior middle temporal gyrus (pMTG) to co-vary with NAC. In addition to these areas, action codes increased activity in object-compatible action in bilateral PMv, right IPS, and lateral occipital cortex (LO). Findings suggest that during action observation, the brain derives possible actions from perceived objects, and uses this information to shape action recognition. In particular, the number of expectable actions quantifies the activity level at PMv, IPL, and pMTG, but only PMv reflects their biased competition while observed action unfolds.
    Frontiers in Psychology 06/2014; 5:636. DOI:10.3389/fpsyg.2014.00636 · 2.80 Impact Factor