Premium
Gradient‐based back‐propagation dynamical iterative learning scheme for the neuro‐fuzzy inference system
Author(s) -
Nejad Hadi Chahkandi,
Farshad Mohsen,
Rahatabad Fereidoun Nowshiravan,
Khayat Omid
Publication year - 2016
Publication title -
expert systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.365
H-Index - 38
eISSN - 1468-0394
pISSN - 0266-4720
DOI - 10.1111/exsy.12131
Subject(s) - computer science , sensitivity (control systems) , adaptive neuro fuzzy inference system , convergence (economics) , algorithm , fuzzy logic , mathematical optimization , artificial intelligence , fuzzy control system , mathematics , electronic engineering , economic growth , engineering , economics
In this paper, a gradient‐based back propagation dynamical iterative learning algorithm is proposed for structure optimization and parameter tuning of the neuro‐fuzzy system. Premise and consequent parameters of the neuro‐fuzzy model are initialized randomly and then tuned by the proposed iterative algorithm. The learning algorithm is based on the first order partial derivative of the output with respect to the structure parameters. The first order derivative of the model output with respect to the structure parameters determines the sensitivity of the model to structure parameters. The sensitivity values are then used to set the tuning factors and parameters updating step sizes. Therefore, an adaptive dynamical iterative scheme is achieved which adapts the learning procedure to the current state of the performance during the optimization process. Larger tuning step sizes make the convergence speed higher and vice versa. In this regard, this parameter is treated according to the calculated sensitivity of the model to the parameter. The proposed learning algorithm is compared with the least square back propagation method, genetic algorithm and chaotic genetic algorithm in the neuro‐fuzzy model structure optimization. Smaller mean square error and shorter learning time are sought in this paper, and the performance of the proposed learning algorithm is versified regarding these criteria.