Premium
Improved Sampling‐Importance Resampling and Reduced Bias Importance Sampling
Author(s) -
Skare Øivind,
Bølviken Erik,
Holden Lars
Publication year - 2003
Publication title -
scandinavian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.359
H-Index - 65
eISSN - 1467-9469
pISSN - 0303-6898
DOI - 10.1111/1467-9469.00360
Subject(s) - mathematics , resampling , sampling (signal processing) , sample (material) , statistics , sample size determination , sampling distribution , simple random sample , slice sampling , convergence (economics) , sampling design , importance sampling , sampling bias , algorithm , monte carlo method , computer science , population , chemistry , demography , filter (signal processing) , chromatography , sociology , economics , computer vision , economic growth
. The sampling‐importance resampling (SIR) algorithm aims at drawing a random sample from a target distribution π. First, a sample is drawn from a proposal distribution q , and then from this a smaller sample is drawn with sample probabilities proportional to the importance ratios π/ q . We propose here a simple adjustment of the sample probabilities and show that this gives faster convergence. The results indicate that our version converges better also for small sample sizes. The SIR algorithms are compared with the Metropolis–Hastings (MH) algorithm with independent proposals. Although MH converges asymptotically faster, the results indicate that our improved SIR version is better than MH for small sample sizes. We also establish a connection between the SIR algorithms and importance sampling with normalized weights. We show that the use of adjusted SIR sample probabilities as importance weights reduces the bias of the importance sampling estimate.