Premium
Exponential convergence of products of random matrices: Application to adaptive algorithms
Author(s) -
Moustakides George V.
Publication year - 1998
Publication title -
international journal of adaptive control and signal processing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.73
H-Index - 66
eISSN - 1099-1115
pISSN - 0890-6327
DOI - 10.1002/(sici)1099-1115(199811)12:7<579::aid-acs519>3.0.co;2-h
Subject(s) - ergodicity , convergence (economics) , independence (probability theory) , algorithm , markov chain , rate of convergence , mathematics , exponential function , computer science , mathematical optimization , class (philosophy) , artificial intelligence , key (lock) , statistics , mathematical analysis , computer security , economics , economic growth
We introduce a novel methodology for analysing well known classes of adaptive algorithms. Combining recent developments concerning geometric ergodicity of stationary Markov processes and long existing results from the theory of Perturbations of Linear Operators we first study the behaviour and convergence properties of a class of products of random matrices, this is turn allows for the analysis of the first and second order statistics of adaptive algorithms without the need of any restrictive conditions imposed on the data (as essential boundedness). Efficient estimates of the convergence rate of adaptive algorithms during the initial transient phase are also presented. These estimates do not rely on the unrealistic Independence Assumption as it is commonly the case in existing literature. © 1998 John Wiley & Sons, Ltd.