Markov chain Monte Carlo posterior sampling with the Hamiltonian method

Kenneth M. Hanson

doi:10.1117/12.431119

3 July 2001 Markov chain Monte Carlo posterior sampling with the Hamiltonian method

Kenneth M. Hanson

Proceedings Volume 4322, Medical Imaging 2001: Image Processing; (2001) https://doi.org/10.1117/12.431119
Event: Medical Imaging 2001, 2001, San Diego, CA, United States

Abstract

The Markov Chain Monte Carlo technique provides a means for drawing random samples from a target probability density function (pdf). MCMC allows one to assess the uncertainties in a Bayesian analysis described by a numerically calculated posterior distribution. This paper describes the Hamiltonian MCMC technique in which a momentum variable is introduced for each parameter of the target pdf. In analogy to a physical system, a Hamiltonian H is defined as a kinetic energy involving the momenta plus a potential energy (phi) , where (phi) is minus the logarithm of the target pdf. Hamiltonian dynamics allows one to move along trajectories of constant H, taking large jumps in the parameter space with relatively few evaluations of (phi) and its gradient. The Hamiltonian algorithm alternates between picking a new momentum vector and following such trajectories. I show that the efficiency of the Hamiltonian method for multidimensional isotropic Gaussian pdfs remains constant at around 7% for up to several hundred dimensions. The Hamiltonian method handles correlations among the variables much better than the standard Metropolis algorithm. A new test, based on the gradient of (phi) , is proposed to measure the convergence of the MCMC sequence.

Citation Download Citation

Kenneth M. Hanson "Markov chain Monte Carlo posterior sampling with the Hamiltonian method", Proc. SPIE 4322, Medical Imaging 2001: Image Processing, (3 July 2001); https://doi.org/10.1117/12.431119

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available