Conversion of Certain Stochastic Control Problems into Deterministic Control Problems
Author(s) -
William M. McEneaney,
Peter M. Dower
Publication year - 2020
Publication title -
ifac-papersonline
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.308
H-Index - 72
eISSN - 2405-8971
pISSN - 2405-8963
DOI - 10.1016/j.ifacol.2020.12.005
Subject(s) - mathematics , equivalence (formal languages) , stochastic control , optimal control , mathematical optimization , partial differential equation , minification , nonlinear system , stochastic partial differential equation , regular polygon , mathematical analysis , pure mathematics , physics , geometry , quantum mechanics
A class of nonlinear, stochastic staticization control problems (including minimization problems with smooth, convex, coercive payoffs) driven by diffusion dynamics with constant diffusion coefficient is considered. A fundamental solution form is obtained where the same solution can be used for a limited variety of terminal costs without re-solution of the problem. One may convert this fundamental solution form from a stochastic control problem form to a deterministic control problem form. This yields an equivalence between certain second-order (in space) Hamilton-Jacobi partial differential equations (HJ PDEs) and associated first-order HJ PDEs. This reformulation has substantial numerical implications.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom