Premium
Transformation invariance in pattern recognition: Tangent distance and propagation
Author(s) -
Simard Patrice Y.,
Le Cun Yann A.,
Denker John S.,
Victorri Bernard
Publication year - 2000
Publication title -
international journal of imaging systems and technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.359
H-Index - 47
eISSN - 1098-1098
pISSN - 0899-9457
DOI - 10.1002/1098-1098(2000)11:3<181::aid-ima1003>3.0.co;2-e
Subject(s) - transformation (genetics) , computer science , invariance principle , pattern recognition (psychology) , mathematics , artificial intelligence , philosophy , biochemistry , chemistry , gene , linguistics
In pattern recognition, statistical modeling, or regression, the amount of data is a critical factor affecting the performance. If the amount of data and computational resources are unlimited, even trivial algorithms will converge to the optimal solution. However, in the practical case, given limited data and other resources, satisfactory performance requires sophisticated methods to regularize the problem by introducing a priori knowledge. Invariance of the output with respect to certain transformations of the input is a typical example of such a priori knowledge. We introduce the concept of tangent vectors, which compactly represent the essence of these transformation invariances, and two classes of algorithms, tangent distance and tangent propagation, which make use of these invariances to improve performance. © 2001 John Wiley & Sons, Inc. Int J Imaging Syst Technol 11, 181–197, 2000