Conference Paper

Fusion of Visual and Thermal Signatures with Eyeglass Removal for Robust Face Recognition

The University of Tennessee, Knoxville
DOI: 10.1109/CVPR.2004.77 Conference: Computer Vision and Pattern Recognition Workshop, 2004 Conference on
Source: IEEE Xplore

ABSTRACT This paper describes a fusion of visual and thermal infrared (IR) images for robust face recognition. Two types of fusion methods are discussed: data fusion and decision fusion. Data fusion produces an illumination-invariant face image by adaptively integrating registered visual and thermal face images. Decision fusion combines matching scores of individual face recognition modules. In the data fusion process, eyeglasses, which block thermal energy, are detected from thermal images and replaced with an eye template. Three fusion-based face recognition techniques are implemented and tested: Data fusion of visual and thermal images (Df), Decision fusion with highest matching score (Fh), and Decision fusion with average matching score (Fa). A commercial face recognition software FaceIt® is used as an individual recognition module. Comparison results show that fusion-based face recognition techniques outperformed individual visual and thermal face recognizers under illumination variations and facial expressions.

  • [Show abstract] [Hide abstract]
    ABSTRACT: In real life, images obtained from video cameras or scanners are usually exposed to different levels of noises and blurring effects. In this paper we propose a new robust score level fusion technique to recognize faces in the presence of noise and blurring effects. The Proposed Score Level Fusion Technique (PSLFT) is obtained by using combinatory approach and Z-Score normalization using the scores obtained from appearance based techniques: Principal Component Analysis (PCA), Fisher faces (FF), Independent Component Analysis (ICA), Fourier Spectra (FS), Singular Value Decomposition (SVD) and Sparse Representation (SR). The system is trained in the absence of noise, blurring effect but tested by imposing different levels of noises and blurring effects thus we have tried to imitate the real world scenarios. To investigate the performance of PSLFT, we simulate the real world scenario by adding noises: Median noise, Salt and pepper noise and also adding blurring effects: Motion blur and Gaussian blur. To evaluate performance of the PSLFT, we have considered six standard public face databases: IITK, ATT, JAFEE, CALTECH, GRIMANCE, and SHEFFIELD.
    Proceedings of the 2013 2nd International Conference on Advanced Computing, Networking and Security; 12/2013
  • Source
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this work we seek to provide insight on the general topic of soft biometrics. We firstly present a new refined definition of soft biometrics, emphasizing on the aspect of human compliance, and then proceed to identify candidate traits that accept this novel definition. We then address relations between traits and discuss associated benefits and limitations of these traits. We also consider two novel soft biometric traits, namely weight and color of clothes and we analyze their reliability. Related promising results on the performance are provided. Finally, we consider a new application, namely human identification solely carried out by a bag of facial, body and accessory soft biometric traits, and as an evidence of its practicality, we provide preliminary promising results.
    Multimedia Tools and Applications 01/2011; 51(2). DOI:10.1007/s11042-010-0635-7 · 1.06 Impact Factor


Available from