Premium
Event‐triggered optimal tracking control of nonlinear systems
Author(s) -
Vamvoudakis Kyriakos G.,
Mojoodi Arman,
Ferraz Henrique
Publication year - 2016
Publication title -
international journal of robust and nonlinear control
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.361
H-Index - 106
eISSN - 1099-1239
pISSN - 1049-8923
DOI - 10.1002/rnc.3587
Subject(s) - control theory (sociology) , reinforcement learning , controller (irrigation) , computer science , nonlinear system , optimal control , van der pol oscillator , event (particle physics) , stability (learning theory) , control (management) , mathematical optimization , mathematics , artificial intelligence , physics , quantum mechanics , machine learning , agronomy , biology
Summary We propose a novel event‐triggered optimal tracking control algorithm for nonlinear systems with an infinite horizon discounted cost. The problem is formulated by appropriately augmenting the system and the reference dynamics and then using ideas from reinforcement learning to provide a solution. Namely, a critic network is used to estimate the optimal cost while an actor network is used to approximate the optimal event‐triggered controller. Because the actor network updates only when an event occurs, we shall use a zero‐order hold along with appropriate tuning laws to encounter for this behavior. Because we have dynamics that evolve in continuous and discrete time, we write the closed‐loop system as an impulsive model and prove asymptotic stability of the equilibrium point and Zeno behavior exclusion. Simulation results of a helicopter, a one‐link rigid robot under gravitation field, and a controlled Van‐der‐Pol oscillator are presented to show the efficacy of the proposed approach. Copyright © 2016 John Wiley & Sons, Ltd.