Open AccessNear-optimal control of nonlinear systems with simultaneous controlled and random switches
Author(s) -
Lucian Buşoniu,
Jamal Daafouz,
IrinelConstantin Morărescu
Publication year - 2019
Publication title -
ifac-papersonline
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.308
H-Index - 72
eISSN - 2405-8971
pISSN - 2405-8963
DOI - 10.1016/j.ifacol.2019.09.152
Subject(s) - dwell time , signal (programming language) , computer science , nonlinear system , simple (philosophy) , control theory (sociology) , markov decision process , dynamic programming , function (biology) , markov chain , markov process , control (management) , algorithm , mathematical optimization , mathematics , artificial intelligence , physics , medicine , clinical psychology , philosophy , statistics , epistemology , quantum mechanics , machine learning , programming language , evolutionary biology , biology
We consider dual switched systems, in which two switching signals act simultaneously to select the dynamical mode. The first signal is controlled and the second is random, with probabilities that evolve either periodically or as a function of the dwell time. We formalize both cases as Markov decision processes, which allows them to be solved with a simple approximate dynamic programming algorithm. We illustrate the framework in a problem where the random signal is a delay on the control channel that is used to send the controlled signal to the system.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom