Variance-reduced HMM for Stochastic Slow-fast Systems
Author(s) -
Ward Melis,
Giovanni Samaey
Publication year - 2016
Publication title -
procedia computer science
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.334
H-Index - 76
ISSN - 1877-0509
DOI - 10.1016/j.procs.2016.05.497
Subject(s) - estimator , hidden markov model , ergodic theory , computer science , variance reduction , variance (accounting) , mathematics , measure (data warehouse) , invariant measure , convergence (economics) , variable (mathematics) , statistics , algorithm , monte carlo method , artificial intelligence , mathematical analysis , accounting , database , economics , business , economic growth
We propose a novel variance reduction strategy based on control variables for simulating the averaged equation of a stochastic slow-fast system. In this system, we assume that the fast equation is ergodic, implying the existence of an invariant measure, for every fixed value of the slow variable. The right hand side of the averaged equation contains an integral with respect to this unknown invariant measure, which is approximated by the heterogeneous multiscale method (HMM). The HMM method corresponds to a Markov chain Monte Carlo method in which samples are generated by simulating the fast equation for a fixed value of the slow variable. As a consequence, the variance of the HMM estimator decays slowly. Here, we introduce a variance-reduced HMM estimator based on control variables: from the current time HMM estimation, we subtract a second HMM estimator at the previous time step using the same seed as the current time HMM estimator. To avoid introducing a bias, we add the previously calculated variance-reduced estimator. We analyze convergence of the proposed estimator and apply it to a linear and nonlinear model
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom