Open AccessData‐driven design of two‐degree‐of‐freedom controllers using reinforcement learning techniques
Author(s) -
Zhang Yong,
Ding Steven X.,
Yang Ying,
Li Linlin
Publication year - 2015
Publication title -
iet control theory and applications
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.059
H-Index - 108
eISSN - 1751-8652
pISSN - 1751-8644
DOI - 10.1049/iet-cta.2014.0156
Subject(s) - reinforcement learning , control theory (sociology) , degree (music) , computer science , control engineering , reinforcement , artificial intelligence , engineering , control (management) , physics , structural engineering , acoustics
Motivated by the successful application for feedback control, this study extends the study of reinforcement learning techniques to the design of two‐degree‐of‐freedom controllers in the data‐driven environment. Based on the residual generator based form of Youla parameterisation, all stabilising controllers are first interpreted in the feedback–feedforward situation with a Kalman filter‐based residual generator acting as the core part. For the reference tracking problem, further discussions are conducted from the regulatory perspective and using the Q learning, recursive least squares methods and the policy iteration algorithm. The entire design is carried out as a two‐stage process that separately achieves the optimal feedback and feedforward controllers. Finally, the effectiveness of the proposed approach is demonstrated with its application in the laboratory continuous stirred tank heater process.