Performance evaluation of fingerprint verification systems.

Biometric System Laboratory-DEIS, University of Bologna, via Sacchi 3, 47023 Cesena, Italy.
IEEE Transactions on Pattern Analysis and Machine Intelligence (Impact Factor: 5.69). 02/2006; 28(1):3-18. DOI: 10.1109/TPAMI.2006.20
Source: PubMed

ABSTRACT This paper is concerned with the performance evaluation of fingerprint verification systems. After an initial classification of biometric testing initiatives, we explore both the theoretical and practical issues related to performance evaluation by presenting the outcome of the recent Fingerprint Verification Competition (FVC2004). FVC2004 was organized by the authors of this work for the purpose of assessing the state-of-the-art in this challenging pattern recognition application and making available a new common benchmark for an unambiguous comparison of fingerprint-based biometric systems. FVC2004 is an independent, strongly supervised evaluation performed at the evaluators' site on evaluators' hardware. This allowed the test to be completely controlled and the computation times of different algorithms to be fairly compared. The experience and feedback received from previous, similar competitions (FVC2000 and FVC2002) allowed us to improve the organization and methodology of FVC2004 and to capture the attention of a significantly higher number of academic and commercial organizations (67 algorithms were submitted for FVC2004). A new, "Light" competition category was included to estimate the loss of matching performance caused by imposing computational constraints. This paper discusses data collection and testing protocols, and includes a detailed analysis of the results. We introduce a simple but effective method for comparing algorithms at the score level, allowing us to isolate difficult cases (images) and to study error correlations and algorithm "fusion." The huge amount of information obtained, including a structured classification of the submitted algorithms on the basis of their features, makes it possible to better understand how current fingerprint recognition systems work and to delineate useful research directions for the future.

  • Source
    EURASIP Journal on Image and Video Processing 12/2015; 2015(1). DOI:10.1186/s13640-015-0055-8 · 0.66 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The growing of network applications and the advances in network services demand for more complex and flexible network management systems. It becomes difficult to evaluate the performance of such a system using the traditional, simple and arbitrary evaluation methods especially when the system is designed for a specific purpose. Systematic evaluation models should be built to evaluate if a system meets the specified requirements while does not sacrifice much of the network performance. In this paper, we propose a three-dimensional evaluation model for network management system which takes cost, impact, as well as operation into consideration at the same time. We define evaluation index as a performance indicator, which is detailed elaboration for the proposed model. We believe that the three-dimensional evaluation for network evaluation can be better suited in nowadays network environment.
    Procedia Computer Science 12/2013; 17:888-892. DOI:10.1016/j.procs.2013.05.113
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this paper, we propose a novel robust and efficient minutia-based fingerprint matching algorithm. There are two key contributions. First, we apply a set of global level minutia dependent features, i.e., the qualities that measure the reliabilities of the extracted minutiae and the area of overlapping regions between the query and template images of fingerprints. The implementation of these easy-to-get minutia dependent features presents coherence to the well-accepted fingerprint template standards. Besides, the reasonable combination of them results in the robustness to poor quality fingerprint images. Second, we implement a hierarchical recognition strategy, which applies a procedure of global matching that refines the local matching decision towards a genuine result over the entire images. Other than the much improved accuracy, our algorithm also promotes the efficiency, because compared with other state-of-the-art matching approaches, it does not make use of any time-consuming operations or any complex feature structures. The experimental results demonstrate the proposed method exhibits an excellent accuracy that exceeds the performances of well-known minutia based matchers. Meanwhile, the proposed algorithm presents potentials to serve a real-time fingerprint recognition system.
    2013 2nd IAPR Asian Conference on Pattern Recognition (ACPR); 11/2013


Available from