Premium
On‐line partitioning of the sample space in the regional adaptive algorithm
Author(s) -
GreGodbout Nicolas,
Bédard Mylène
Publication year - 2021
Publication title -
canadian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.804
H-Index - 51
eISSN - 1708-945X
pISSN - 0319-5724
DOI - 10.1002/cjs.11562
Subject(s) - ergodicity , recursion (computer science) , hyperplane , algorithm , partition (number theory) , computer science , line (geometry) , mahalanobis distance , space partitioning , mathematics , artificial intelligence , statistics , combinatorics , geometry
The regional adaptive (RAPT) algorithm is particularly useful in sampling from multimodal distributions. We propose an adaptive partitioning of the sample space, to be used in conjunction with the RAPT sampler and its variants. The adaptive partitioning consists in defining a hyperplane that is orthogonal to the line joining averaged coordinates in two separate regions and that goes through a point such that both averaged coordinates are equally Mahalanobis‐distant from this point. This yields an adaptive process that is robust to the choice of initial partition, stabilizes rapidly and is implemented at a marginal computational cost. The ergodicity of the sampler is verified through the simultaneous uniform ergodicity and diminishing adaptation conditions. The approach is compared to the RAPT algorithm with fixed regions and to the RAPT with online recursion (RAPTOR) through various examples, including a real data application. In short, our main contribution is the development of an alternative version of RAPTOR that seems to have no obvious downside and runs 15–35% faster in the examples considered.