Publications (13)65.92 Total impact
-
Article: The perception of humanness from the movements of synthetic agents.
[show abstract] [hide abstract]
ABSTRACT: As technology develops, social robots and synthetic avatars might begin to play more of a role in our lives. An influential theory of the perception of synthetic agents states that as they begin to look and move in a more human-like way, they elicit profound discomfort in the observer--an effect known as the Uncanny Valley. Previous attempts to examine the existence of the Uncanny Valley have not adequately manipulated movement parameters that contribute to perceptions of the humanness or eeriness. Here we parametrically manipulated three different kinematic features of two walking avatars and found that, contrary to the Uncanny Valley hypothesis, ratings of the humanness, familiarity, and eeriness of these avatars changed monotonically. Our results indicate that, when a full gradient of motion parameter changes is examined, ratings of synthetic agents by human observers do not show an Uncanny Valley.Perception 01/2011; 40(6):695-704. · 1.31 Impact Factor -
Article: Object-based attentional modulation of biological motion processing: spatiotemporal dynamics using functional magnetic resonance imaging and electroencephalography.
[show abstract] [hide abstract]
ABSTRACT: Although it is well documented that the ability to perceive biological motion is mediated by the lateral temporal cortex, whether and when neural activity in this brain region is modulated by attention is unknown. In particular, it is unclear whether the processing of biological motion requires attention or whether such stimuli are processed preattentively. Here, we used functional magnetic resonance imaging, high-density electroencephalography, and cortically constrained source estimation methods to investigate the spatiotemporal effects of attention on the processing of biological motion. Directing attention to tool motion in overlapping movies of biological motion and tool motion suppressed the blood oxygenation level-dependent (BOLD) response of the right superior temporal sulcus (STS)/middle temporal gyrus (MTG), while directing attention to biological motion suppressed the BOLD response of the left inferior temporal sulcus (ITS)/MTG. Similarly, category-based modulation of the cortical current source density estimates from the right STS/MTG and left ITS was observed beginning at approximately 450 ms following stimulus onset. Our results indicate that the cortical processing of biological motion is strongly modulated by attention. These findings argue against preattentive processing of biological motion in the presence of stimuli that compete for attention. Our findings also suggest that the attention-based segregation of motion category-specific responses only emerges relatively late (several hundred milliseconds) in processing.Journal of Neuroscience 07/2010; 30(27):9064-73. · 7.11 Impact Factor -
Article: Detecting threat-related intentional actions of others: effects of image quality, response mode, and target cuing on vigilance.
[show abstract] [hide abstract]
ABSTRACT: Three experiments examined the vigilance performance of participants watching videos depicting intentional actions of an individual's hand reaching for and grasping an object--involving transporting or using either a gun or a hairdryer--in order to detect infrequent threat-related actions. Participants indicated detection of target actions either manually or by withholding response. They also rated their subjective mental workload before and after each vigilance task. Irrespective of response mode, the detection rate of intentional threats declined over time on task and subjective workload increased, but only under visually degraded viewing conditions. This vigilance decrement was attenuated by temporal cues that were 75% valid in predicting a subsequent target action and eliminated with 100% valid cues. The findings indicate that detection of biological motion targets, and threat-related intentional actions in particular, although not attention sensitive under normal viewing conditions, is subject to vigilance decrement under degraded viewing conditions. The results are compatible with the view that the decrement in detecting threat-related intentional actions reflects increasing failure of attention allocation processes over time.Journal of Experimental Psychology Applied 12/2009; 15(4):275-90. · 1.75 Impact Factor -
Article: Visual working memory capacity for objects from different categories: a face-specific maintenance effect.
[show abstract] [hide abstract]
ABSTRACT: The capacity of visual working memory was examined when complex objects from different categories were remembered. Previous studies have not examined how visual similarity affects object memory, though it has long been known that similar-sounding phonological information interferes with rehearsal in auditory working memory. Here, experiments required memory for two or four objects. Memory capacity was compared between remembering four objects from a single object category to remembering four objects from two different categories. Two-category sets led to increased memory capacity only when upright faces were included. Capacity for face-only sets never exceeded their nonface counterparts, and the advantage for two-category sets when faces were one of the categories disappeared when inverted faces were used. These results suggest that two-category sets which include faces are advantaged in working memory but that faces alone do not lead to a memory capacity advantage.Cognition 08/2008; 108(3):719-31. · 3.16 Impact Factor -
Article: The first time ever I saw your face.
[show abstract] [hide abstract]
ABSTRACT: The perception of social information is crucial for the survival of most animal species. Two recent studies demonstrate the joint contribution of innate mechanisms and perceptual experience to two aspects of social perception--faces and biological motion. Together, they highlight how important it is to consider faces and biological motion as different visual properties used by a broader social perception system.Trends in Cognitive Sciences 08/2008; 12(8):283-4. · 12.59 Impact Factor -
Article: The left amygdala knows fear: laterality in the amygdala response to fearful eyes.
[show abstract] [hide abstract]
ABSTRACT: The detection of threat is a role that the amygdala plays well, evidenced by its increased response to fearful faces in human neuroimaging studies. A critical element of the fearful face is an increase in eye white area (EWA), hypothesized to be a significant cue in activating the amygdala. However, another important social signal that can increase EWA is a lateral shift in gaze direction, which also serves to orient attention to potential threats. It is unknown how the amygdala differentiates between these increases in EWA and those that are specifically associated with fear. Using functional magnetic resonance imaging, we show that the left amygdala distinguished between fearful eyes and gaze shifts despite similar EWA increases whereas the right amygdala was less discriminatory. Additional analyses also revealed selective hemispheric response patterns in the left fusiform gyrus. Our data show clear hemispheric differences in EWA-based fear activation, suggesting the existence of parallel mechanisms that code for emotional face information.Social Cognitive and Affective Neuroscience 04/2008; 3(1):47-54. · 6.13 Impact Factor -
Article: Common and distinct brain activation to viewing dynamic sequences of face and hand movements.
[show abstract] [hide abstract]
ABSTRACT: The superior temporal sulcus (STS) and surrounding lateral temporal and inferior parietal cortices are an important part of a network involved in the processing of biological movement. It is unclear whether the STS responds to the movement of different body parts uniformly, or if the response depends on the body part that is moving. Here we examined brain activity to recognizing sequences of face and hand movements as well as radial grating motion, controlling for differences in movement dynamics between stimuli. A region of the right posterior STS (pSTS) showed common activation to both face and hand motion, relative to radial grating motion, with no significant difference between responses to face and hand motion in this region. Distinct responses to face motion relative to hand motion were observed in the right mid-STS, while the right posterior inferior temporal sulcus (pITS) and inferior parietal lobule (IPL) showed greater responses to hand motion relative to face motion. These findings indicate that while there may be distinct processing of different body part motion in lateral temporal and inferior parietal cortices, the response of the pSTS is not body part specific. This region may provide input to other parts of a network involved with processing human actions with a high-level visual description of biological motion.NeuroImage 10/2007; 37(3):966-73. · 5.89 Impact Factor -
Article: It's all in the eyes: neural responses to socially significant gaze shifts.
[show abstract] [hide abstract]
ABSTRACT: Gaze direction signals another's focus of social attention. Here, we recorded event-related potentials to a multiface display where a gaze aversion created three different social scenarios involving social attention, mutual gaze exchange, and gaze avoidance. N170 was unaffected by social scenario. P350 latency was the shortest in social attention and mutual gaze exchange, whereas P500 was thelargest for gaze avoidance. Our data suggest that neural activity after 300 ms poststimulus may index processes associated with extracting social meaning, whereas that earlier than 300 ms may index processing of gaze change independent of social context.Neuroreport 06/2007; 18(8):763-6. · 1.66 Impact Factor -
Article: Neural responses elicited to face motion and vocalization pairings.
[show abstract] [hide abstract]
ABSTRACT: During social interactions our brains continuously integrate incoming auditory and visual input from the movements and vocalizations of others. Yet, the dynamics of the neural events elicited to these multisensory stimuli remain largely uncharacterized. Here we recorded audiovisual scalp event-related potentials (ERPs) to dynamic human faces with associated human vocalizations. Audiovisual controls were a dynamic monkey face with a species-appropriate vocalization, and a house with opening front door with a creaking door sound. Subjects decided if audiovisual stimulus trials were congruent (e.g. human face-human sound) or incongruent (e.g. house image-monkey sound). An early auditory ERP component, N140, was largest to human and monkey vocalizations. This effect was strongest in the presence of the dynamic human face, suggesting that species-specific visual information can modulate auditory ERP characteristics. A motion-induced visual N170 did not change amplitude or latency across visual motion category in the presence of sound. A species-specific incongruity response consisting of a late positive ERP at around 400 ms, P400, was selectively larger only when human faces were mismatched with a non-human sound. We also recorded visual ERPs at trial onset, and found that the category-specific N170 did not alter its behavior as a function of stimulus category-somewhat unexpected as two face types were contrasted with a house image. In conclusion, we present evidence for species-specificity in vocalization selectivity in early ERPs, and in a multisensory incongruity response whose amplitude is modulated only when the human face motion is paired with an incongruous auditory stimulus.Neuropsychologia 02/2007; 45(1):93-106. · 3.64 Impact Factor -
Article: Configural processing of biological motion in human superior temporal sulcus.
[show abstract] [hide abstract]
ABSTRACT: Observers recognize subtle changes in the movements of others with relative ease. However, tracking a walking human is computationally difficult, because the degree of articulation is high and scene changes can temporarily occlude parts of the moving figure. Here, we used functional magnetic resonance imaging to test the hypothesis that the superior temporal sulcus (STS) uses form cues to aid biological movement tracking. The same 10 healthy subjects detected human gait changes in a walking mannequin in two experiments. In experiment 1, we tested the effects of configural change and occlusion. The walking mannequin was presented intact or with the limbs and torso apart in visual space and either unoccluded or occluded by a set of vertical white bars. In experiment 2, the effects of inversion and occlusion were investigated, using an intact walking mannequin. Subjects reliably detected gait changes under all stimulus conditions. The intact walker produced significantly greater activation in the STS, inferior temporal sulcus (ITS), and inferior parietal cortex relative to the apart walker, regardless of occlusion. Interestingly, STS and ITS activation to the upright versus inverted walker was not significantly different. In contrast, superior parietal lobule and parieto-occipital cortex showed greater activation to the apart relative to intact walker. In the absence of an intact body configuration, parietal cortex activity increased to the independent movements of the limbs and torso. Our data suggest that the STS may use a body configuration-based model to process biological movement, thus forming a representation that survives partial occlusion.Journal of Neuroscience 10/2005; 25(39):9059-66. · 7.11 Impact Factor -
Article: Digit representation is more than just hand waving.
[show abstract] [hide abstract]
ABSTRACT: Lip-reading and interpreting hand gestures help provide nonverbal information that aids speech comprehension in noisy environments and places emphasis on certain key utterances. In this fMRI study, we examined if viewing the similar semantic information presented by either finger movements or lip movements was processed by common or discrete brain regions. Subjects viewed videos of a hand conveying number information via finger movements and a face whose lip movements conveyed the same numerical information. Control stimuli consisted of meaningless finger and lip movements. Lip-reading numbers activated left posterior superior temporal sulcus (STS), while identifying numbers presented by fingers activated the intraparietal region (IPR) bilaterally. Conjunction analysis highlighted common activation in right IPR to numbers presented via fingers and lips. Our data indicate that left hemisphere decodes human movements conveying semantic information, although the specific brain region that is engaged may depend on the body part that is moving.Cognitive Brain Research 11/2004; 21(3):412-7. · 3.77 Impact Factor -
Article: Viewing the motion of human body parts activates different regions of premotor, temporal, and parietal cortex.
[show abstract] [hide abstract]
ABSTRACT: Activation of premotor and temporoparietal cortex occurs when we observe others movements, particularly relating to objects. Viewing the motion of different body parts without the context of an object has not been systematically evaluated. During a 3T fMRI study, 12 healthy subjects viewed human face, hand, and leg motion, which was not directed at or did not involve an object. Activation was identified relative to static images of the same human face, hand, and leg in both individual subject and group average data. Four clear activation foci emerged: (1) right MT/V5 activated to all forms of viewed motion; (2) right STS activated to face and leg motion; (3) ventral premotor cortex activated to face, hand, and leg motion in the right hemisphere and to leg motion in the left hemisphere; and (4) anterior intraparietal cortex (aIP) was active bilaterally to viewing hand motion and in the right hemisphere leg motion. In addition, in the group data, a somatotopic activation pattern for viewing face, hand, and leg motion occurred in right ventral premotor cortex. Activation patterns in STS and aIP were more complex--typically activation foci to viewing two types of human motion showed some overlap. Activation in individual subjects was similar; however, activation to hand motion also occurred in the STS with a variable location across subjects--explaining the lack of a clear activation focus in the group data. The data indicate that there are selective responses to viewing motion of different body parts in the human brain that are independent of object or tool use.NeuroImage 06/2004; 22(1):277-88. · 5.89 Impact Factor -
Article: The human temporal lobe integrates facial form and motion: evidence from fMRI and ERP studies.
[show abstract] [hide abstract]
ABSTRACT: Physiological studies in humans and monkeys indicate that the posterior temporal cortex is active when viewing the movements of others. Here we tested the premise that this region integrates form and motion information by presenting both natural and line-drawn displays of moving faces and motion controls where motion was continuously presented in the same part of the visual field. The cortex in and near the STS and on the fusiform gyrus (FG) responded to both types of face stimuli, but not to the controls, in a functional magnetic resonance imaging study in 10 normal subjects. The response in the STS to both types of facial motion was equal in magnitude, whereas in the FG the natural image of the face produced a significantly greater response than that of the line-drawn face. In a subsequent recording session, the electrical activity of the brain was recorded in the same subjects to the same activation task. Significantly larger event-related potentials (ERPs) to both types of moving faces were observed over the posterior temporal scalp compared to the motion controls at around 200 ms postmotion onset. Taken together, these data suggest that regions of temporal cortex actively integrate form and motion information-a process largely independent of low-level visual processes such as changes in local luminance and contrast.NeuroImage 08/2003; 19(3):861-9. · 5.89 Impact Factor
Top co-authors
Top Journals
- NeuroImage (3)
- Journal of Neuroscience (2)
- Cognition (1)
- Neuropsychologia (1)
- Perception (1)
Institutions
-
2007–2011
-
George Mason University
- Department of Psychology
Fairfax, VA, USA
-
-
2005–2008
-
West Virginia University
- Center for Advanced Imaging
Morgantown, WV, USA
-
-
2004
-
Swinburne University of Technology
- Brain Sciences Institute
Melbourne, Victoria, Australia
-
