
Critical examination of the IREX VI results
Author(s) -
Bowyer Kevin W.,
Ortiz Estefan
Publication year - 2015
Publication title -
iet biometrics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.434
H-Index - 28
ISSN - 2047-4946
DOI - 10.1049/iet-bmt.2014.0007
Subject(s) - computer science , hamming distance , ageing , matching (statistics) , value (mathematics) , standardization , regression , iris recognition , iris (biosensor) , pattern recognition (psychology) , artificial intelligence , statistics , mathematics , algorithm , machine learning , medicine , biometrics , operating system
The authors analyse why Iris Exchange Report (IREX) VI conclusions about ‘iris ageing’ differ significantly from results of previous research on ‘iris template ageing’. They observe that IREX VI uses a definition of ‘iris ageing’ that is restricted to a subset of International Organization for Standardization (ISO)‐definition template ageing. They also explain how IREX VI commits various methodological errors in obtaining what it calls its ‘best estimate of iris recognition ageing’. The OPS‐XING dataset that IREX VI analyses for its ‘best estimate of iris recognition ageing’ contains no matches with Hamming distance >0.27. A ‘truncated regression’ technique should be used to analyse such a dataset, which IREX VI fails to do so, biasing its ‘best estimate’ to be lower‐than‐correct. IREX VI mixes Hamming distances from first, second and third attempts together in its regression, creating another source of bias towards a lower‐than‐correct value. In addition, the match scores in the OPS‐XING dataset are generated from a ‘1‐to‐first’ matching strategy, meaning that they contain a small but unknown number of impostor matches, constituting another source of bias towards an artificially low value for ageing. Finally, IREX VI makes its ‘best estimate of iris recognition ageing’ by interpreting its regression model without taking into account the correlation among independent variables. This is another source of bias towards an artificially low value for ageing. Importantly, the IREX VI report does not acknowledge the existence of any of these sources of bias. They conclude with suggestions for a revised, improved IREX VI.