Premium
A network model using distance‐based cosine elements
Author(s) -
Oike Koichi,
Koakutsu Seiichi,
Hirata Hironori
Publication year - 1999
Publication title -
electrical engineering in japan
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.136
H-Index - 28
eISSN - 1520-6416
pISSN - 0424-7760
DOI - 10.1002/(sici)1520-6416(199912)129:4<87::aid-eej11>3.0.co;2-w
Subject(s) - backpropagation , sigmoid function , discrete cosine transform , trigonometric functions , convergence (economics) , artificial neural network , algorithm , sine , affine transformation , mathematics , computer science , artificial intelligence , geometry , pure mathematics , economics , image (mathematics) , economic growth
In this paper, we propose a new network element, “distance‐based cosine element,” for neural networks. We also derive a learning algorithm based on the backpropagation algorithms for multilayer networks, The distance‐based cosine element inputs a squared distance between an input pattern vector and its weight vector, and uses an affine transformation of cosine function as its output function. The proposed distance‐based cosine network is able to improve its learning speed as well as convergence rate because its output function does not have any saturated regions which cause slow learning speed of the backpropagation learning using sigmoid elements. We demonstrate the advantages of the proposed network by solving N ‐bit parity problems and Fisher's iris classification problem. Experimental results indicate that our distance‐based cosine network consistently obtains better results than the conventional sigmoid network in terms of both the learning speed and the convergence rate. © 1999 Scripta Technica, Electr Eng Jpn, 129(4): 87–95, 1999