Premium
Iterative Path Integral Approach to Nonlinear Stochastic Optimal Control Under Compound Poisson Noise
Author(s) -
Yuta Okumura,
Kashima Kenji,
Ohta Yoshito
Publication year - 2017
Publication title -
asian journal of control
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.769
H-Index - 53
eISSN - 1934-6093
pISSN - 1561-8625
DOI - 10.1002/asjc.1402
Subject(s) - stochastic control , path integral formulation , mathematics , nonlinear system , brownian motion , optimal control , outlier , noise (video) , probability density function , white noise , mathematical optimization , path (computing) , poisson distribution , computer science , physics , statistics , quantum mechanics , artificial intelligence , image (mathematics) , quantum , programming language
Nonlinear stochastic optimal control theory has played an important role in many fields. In this theory, uncertainties of dynamics have usually been represented by Brownian motion, which is Gaussian white noise. However, there are many stochastic phenomena whose probability density has a long tail, which suggests the necessity to study the effect of non‐Gaussianity. This paper employs Lévy processes, which cause outliers with a significantly higher probability than Brownian motion, to describe such uncertainties. In general, the optimal control law is obtained by solving the Hamilton–Jacobi–Bellman equation. This paper shows that the path‐integral approach combined with the policy iteration method is efficiently applicable to solve the Hamilton–Jacobi–Bellman equation in the Lévy problem setting. Finally, numerical simulations illustrate the usefulness of this method.