Swapna Agarwal

Swapna Agarwal
Tata Consultancy Services Limited | TCS · TCS Innovation Labs

PhD

About

13
Publications
2,584
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
102
Citations
Additional affiliations
December 2011 - present
Indian Statistical Institute
Position
  • Researcher
January 2006 - May 2006
Visva Bharati University
Position
  • Master's Student

Publications

Publications (13)
Article
For synthesis of realistic facial expressions displaying emotions, we need an efficient representation of pure (e.g., surprise) as well as mixed (e.g., happily surprised) emotional expressions. In this paper, we train an Expression Map (XM) that efficiently represents the emotional expressions. We propose an algorithm that utilizes the XM to synthe...
Conference Paper
In this paper, a shape-constrained iterative algorithm is proposed to register a rigid template point-cloud to a given reference point-cloud. The algorithm embeds a shape-based similarity constraint into the principle of gravitation. The shape-constrained gravitation, as induced by the reference, controls the movement of the template such that at e...
Article
Full-text available
We present a computer vision-based system named Anubhav (a Hindi word meaning feeling) which recognizes emotional facial expressions from streaming face videos. Our system runs at a speed of 10 frames per second (fps) on a 3.2-GHz desktop and at 3 fps on an Android mobile device. Using entropy and correlation-based analysis, we show that some parti...
Article
Full-text available
A novel bag-of-words based approach is proposed for recognizing facial expressions corresponding to each of the six basic prototypic emotions from a video sequence. Each video sequence is represented as a specific combination of local (in spatio-temporal scale) motion patterns. These local motion patterns are captured in motion descriptors (MDs) wh...
Article
Alzheimer's disease (AD) is a dementia that gets worse with time resulting in loss of memory and cognitive functions. The life expectancy of AD patients following diagnosis is approximately seven years. In 2006, researchers estimated that 0.40% of the world population (range 0.17% - 0.89%) were afflicted by AD, and that the prevalence rate would be...
Conference Paper
Full-text available
We present a novel framework for recognition of facial expressions from a given face image. The framework is based on the assumption that expression information lies in the subspace orthogonal to the subspace representing expression-neutral faces. For deriving the principal subspace of the face images showing no expression, PCA is used as a tool. T...
Conference Paper
In recent years the need of a robust facial component tracking especially lip tracking algorithm has increased dramatically. We implement an active contour (snake) model inspired by human perception for lip tracking. In addition to the conventional energy terms for tension, rigidity (internal energy) and gradient magnitude (external energy) we prop...
Conference Paper
In real life facial expressions show mixture of emotions. This paper proposes a novel expression descriptor based expression map that can efficiently represent pure, mixture and transition of facial expressions. The expression descriptor is the integration of optic flow and image gradient values and the descriptor value is accumulated in temporal s...
Conference Paper
Full-text available
Imposing expressions on expression-neutral human face images is an interesting application of human-computer-interaction, animation, entertainment and other such fields. The objective of this paper is to impose one of the six prototypic emotional expressions i.e., Joy, Surprise, Disgust, Fear, Anger and Sorrow to a given expression-neutral face ima...
Article
Full-text available
A novel graph theoretic approach is proposed for recognizing each of the six basic prototypic human emotional facial expressions from a video sequence. The feature used, called a Shape-Motion-Descriptor (SMD), is based on orientation-quantized gradient-weighted optical flow in a hierarchical manner. The basis of the SMD is learned using a codebook...

Questions

Questions (2)
Question
I need MATLAB/C++ implementation of any recently published algorithm for facial expression synthesis/transfer. Can anyone please help me in this regard? Thanks in advance for your help.
Question
Hello,
Generally expression synthesis algorithms impose one of the six universal expressions on a given expression-neutral face image. I wish to impose a combination of these basic expressions on a given face image. Can anyone please help me in this regard?
Thanks for your help in advance.
-Swapna Agarwal

Network

Cited By

Projects

Projects (2)
Project
Research in cognitive robotics is concerned with endowing robots with higher level cognitive functions that enable them to reason, act and have conceptual understanding of the world like humans. For example, such robots must be able to reason about goals, actions, when to perceive and what to look for while they autonomously explore their environment and determine which are the important features that need to be considered for making a decision. They should also understand the cognitive states of other agents required for collaborative task execution, do dialogue exchange with other agents if they do not understand instructions and can enhance itself quickly by learning new behaviour automatically from the observations of a dynamic environment. In short, cognitive robotics is concerned with integrating AI, perception, reasoning, human-robot interactions, continual learning, and action with a theoretical and implementation framework. Such frameworks will have a big role to play in Service Robotics, Tele-presence, Tele-operations, Enterprise Robotics and Industry 4.0 which aims to revolutionalize current industrial automation through the use of technologies such as Computer Vision(See some tech demos at https://sites.google.com/view/brojeshwar/publications?authuser=0) ,Multi-view Geometry, Reinforcement Learning, Computer Graphics, Human Robot Interaction, Networking and Communication, Knowledge Representation, Robotics and Artificial Intelligence.
Project
Recognition of Human Emotions through Facial Expressions.