×

Adaptive Markov chain Monte Carlo through regeneration. (English) Zbl 1064.65503

Summary: Markov chain Monte Carlo (MCMC) is used for evaluating expectations of functions of interest under a target distribution \(\pi\). This is done by calculating averages over the sample path of a Markov chain having \(\pi\) as its stationary distribution. For computational efficiency, the Markov chain should be rapidly mixing. This sometimes can be achieved only by careful design of the transition kernel of the chain, on the basis of a detailed preliminary exploratory analysis of \(\pi\). An alternative approach might be to allow the transition kernel to adapt whenever new features of \(\pi\) are encountered during the MCMC run. However, if such adaptation occurs infinitely often, then the stationary distribution of the chain may be disturbed. We describe a framework, based on the concept of Markov chain regeneration, which allows adaptation to occur infinitely often but does not disturb the stationary distribution of the chain or the consistency of sample path averages.

MSC:

65C40 Numerical analysis or methods applied to Markov chains
62F15 Bayesian inference
PDFBibTeX XMLCite
Full Text: DOI