Generalized perceptron learning rule and its implications for photorefractive neural networks
Author(s) -
Chau-Jern Cheng,
Pochi Yeh,
Ken Y. Hsu
Publication year - 1994
Publication title -
journal of the optical society of america b
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.741
H-Index - 144
eISSN - 1520-8540
pISSN - 0740-3224
DOI - 10.1364/josab.11.001619
Subject(s) - convergence (economics) , perceptron , erasure , artificial neural network , multilayer perceptron , computer science , photorefractive effect , weight , artificial intelligence , learning rule , algorithm , mathematics , physics , optics , lie algebra , pure mathematics , economics , programming language , economic growth
We consider the properties of a generalized perceptron learning network, taking into account the decay or the gain of the weight vector during the training stages. A mathematical proof is given that shows the conditional convergence of the learning algorithm. The analytical result indicates that the upper bound of the training steps is dependent on the gain (or decay) factor. A sufficient condition of exposure time for convergence of a photorefractive perceptron network is derived. We also describe a modified learning algorithm that provides a solution to the problem of weight vector decay in an optical perceptron caused by hologram erasure. Both analytical and simulation results are presented and discussed.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom