Premium
Optimal output feedback control for discrete‐time Markov jump linear system with input delay and packet losses
Author(s) -
Liu Yue,
Han Chunyan,
Wang Xiaohong,
Wang Wei
Publication year - 2020
Publication title -
optimal control applications and methods
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.458
H-Index - 44
eISSN - 1099-1514
pISSN - 0143-2087
DOI - 10.1002/oca.2680
Subject(s) - control theory (sociology) , controller (irrigation) , jump , markov process , network packet , optimal control , discrete time and continuous time , filter (signal processing) , mathematics , state variable , separation principle , state (computer science) , linear system , computer science , mathematical optimization , control (management) , nonlinear system , algorithm , state observer , computer network , statistics , physics , quantum mechanics , artificial intelligence , mathematical analysis , agronomy , computer vision , biology , thermodynamics
Summary This article investigates the optimal output feedback control problem for discrete‐time Markov jump linear system (MJLS) with input delay and packet losses in finite horizon. There are three main contributions. First, we assume that the state variable and the jump variable are available to the controller, and then we propose a new version of stochastic maximum principle. Based on the new proposed tool, an optimal state feedback controller is obtained by solving a set of delayed coupled difference Riccati equations. Second, under the condition that the state variable is unavailable to the controller, it is desired to design a dynamic Markovian jump controller such that the closed‐loop system minimizes the performance index. Thus, an optimal Markovian jump linear filter is proposed for MJLS with input delay and packet losses. Finally, based on the optimal filter, we prove that the separation principle holds for this case and then an optimal output feedback controller is presented. Some numerical examples are presented to illustrate the proposed approach.