Hessian-based Markov-Chain Monte Carlo Algorithms
- đ¤ Speaker: Tom Minka (Microsoft Research Ltd)
- đ Date & Time: Thursday 02 July 2009, 14:00 - 15:30
- đ Venue: Engineering Department, CBL Room 438
Abstract
Hessian-based Markov-Chain Monte Carlo Algorithms Tom Minka Microsoft Research Cambridge —— I will talk about how to make Markov-chain Monte Carlo run more efficiently in high-dimensional, continuous spaces. The idea is to shape the Markov transition density according to the local Hessian of the probability density function. This leads to a Hessian-based Metropolis-Hastings algorithm that we call HMH . A naive implementation of this idea would be quite expensive however, requiring the Hessian to be recomputed at each sample. Instead I will describe how to incrementally update the Hessian, and how to get many samples from the same Hessian (using the multiple-try Metropolis algorithm). The upshot is that, given any function where you can do efficient Hessian-based optimization, you can also do efficient sampling.
Joint work with Yuan (Alan) Qi.
Link to paper: http://www.cs.purdue.edu/homes/alanqi/papers.html
Series This talk is part of the Machine Learning Reading Group @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Cambridge University Engineering Department Talks
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- custom
- Engineering Department, CBL Room 438
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Machine Learning Reading Group
- Machine Learning Reading Group @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- ob366-ai4er
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- School of Technology
- Simon Baker's List
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)


Thursday 02 July 2009, 14:00-15:30