Open AccessFinite horizon optimal tracking control of partially unknown linear continuous‐time systems using policy iteration
Author(s) -
Li Chao,
Liu Derong,
Li Hongliang
Publication year - 2015
Publication title -
iet control theory and applications
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.059
H-Index - 108
eISSN - 1751-8652
pISSN - 1751-8644
DOI - 10.1049/iet-cta.2014.1325
Subject(s) - trajectory , algebraic riccati equation , artificial neural network , control theory (sociology) , optimal control , linear quadratic regulator , riccati equation , bellman equation , computer science , state vector , state (computer science) , tracking (education) , mathematical optimization , linear system , mathematics , control (management) , algorithm , partial differential equation , artificial intelligence , mathematical analysis , pedagogy , psychology , physics , classical mechanics , astronomy
In this study, a neural‐network‐based online learning algorithm is established to solve the finite horizon linear quadratic tracking (FHLQT) problem for partially unknown continuous‐time systems. An augmented problem is constructed with an augmented state which consists of the system state and the reference trajectory. The authors obtain a solution for the augmented problem which is equivalent to the standard solution of the FHLQT problem. To solve the augmented problem with partially unknown system dynamics, they develop a time‐varying Riccati equation. A critic neural network is used to approximate the value function and an online learning algorithm is established using the policy iteration technique to solve the time‐varying Riccati equation. An integral policy iteration method and an online tuning law are used when the algorithm is implemented without the knowledge of the system drift dynamics and the command generator dynamics. A simulation example is given to show the effectiveness of the established algorithm.