Weighted biased linear discriminant analysis for misalignment-robust facial expression recognition

Abstract

We investigate in this paper the problem of misalignment-robust facial expression recognition. To the best of our knowledge, this problem has not been formally addressed in the literature. Most existing facial expression recognition methods, however, can only work well when face images are well-aligned. In many real world applications such as human robot interaction and visual surveillance, it is still very challenging to obtain well-aligned face images for expression recognition due to currently imperfect vision techniques, especially under uncontrolled conditions. Motivated by the fact that interclass facial images with small differences are more easily mis-classified than those with large differences, we propose a biased linear discriminant analysis (BLDA) method by imposing large penalties on interclass samples with small differences and small penalties on those samples with large differences simultaneously, such that more discriminative features can be extracted for recognition. Moreover, we generate more virtually misaligned facial expression samples and assign different weights to them according to their occurrence probabilities in the testing phase to learn a weighted BLDA (WBLDA) feature space to extract misalignment-robust discriminative features for recognition. Experimental results on two widely used face databases are presented to show the efficacy of the proposed method.