Premium
Recurrent neural networks with multi‐branch structure
Author(s) -
Yamashita Takashi,
Mabu Shingo,
Hirasawa Kotaro,
Furuzuki Takayuki
Publication year - 2008
Publication title -
electronics and communications in japan
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.131
H-Index - 13
eISSN - 1942-9541
pISSN - 1942-9533
DOI - 10.1002/ecj.10157
Subject(s) - recurrent neural network , benchmark (surveying) , computer science , representation (politics) , artificial neural network , feedforward neural network , artificial intelligence , series (stratigraphy) , algorithm , paleontology , geodesy , politics , political science , law , biology , geography
Universal Learning Networks (ULNs) provide a generalized framework for many kinds of structures in neural networks with supervised learning. Multi‐Branch Neural Networks (MBNNs) which use the framework of ULNs have already been shown to have better representation ability in feedforward neural networks (FNNs). The multi‐branch structure of MBNNs can be easily extended to recurrent neural networks (RNNs) because the characteristics of ULNs include the connection of multiple branches with arbitrary time delays. In this paper, therefore, RNNs with multi‐branch structure are proposed and are shown to have better representation ability than conventional RNNs. RNNs can represent dynamical systems and are useful for time series prediction. The performance evaluation of RNNs with multi‐branch structure was carried out using a benchmark of time series prediction. Simulation results showed that RNNs with multi‐branch structure could obtain better performance than conventional RNNs, and also showed that they could improve the representation ability even if they are smaller‐sized networks. © 2009 Wiley Periodicals, Inc. Electron Comm Jpn, 91(9): 37–44, 2008; Published online in Wiley InterScience ( www.interscience.wiley.com ). DOI 10.1002/ecj.10157