Convergent and Scalable Algorithms for Expectation Propagation Approximate Bayesian Inference
- đ¤ Speaker: Matthias Seeger, EPFL
- đ Date & Time: Tuesday 25 September 2012, 15:00 - 16:00
- đ Venue: Small lecture theatre, Microsoft Research Ltd, 7 J J Thomson Avenue (Off Madingley Road), Cambridge
Abstract
Abstract:
The expectation propagation (or adaptive TAP ) relaxation stands out among variational relaxations of Bayesian inference, when it comes to generality and accuracy of results. It is widely used in machine learning today. Applied to large scale continuous variable models for inverse problems in imaging and computer vision, commonly used solvers lack convergence proofs and are too slow to be useful. In this talk, we describe a novel EP algorithm which is both provably convergent and can be scaled up to large densely connected models, drawing a connection between the double loop algorithm of Opper and Winther (JMLR 2005) and earlier work by the author on scalable algorithms for simpler relaxations. Even for problems of moderate size (such as Gaussian process classification with a few thousand training points), the new algorithm converges at least an order of magnitude faster than the standard (sequential) EP algorithm.
Partly joint work with Hannes Nickisch.
Speaker information: Professor Matthias Seeger runs the Laboratory for Probabilistic Machine Learning (LAPMAP) at EPFL , http://lapmal.epfl.ch/
Series This talk is part of the Microsoft Research Cambridge, public talks series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge Neuroscience Seminars
- Cambridge talks
- CBL important
- Chris Davis' list
- Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Joint Machine Learning Seminars
- Life Science
- Life Sciences
- Machine Learning @ CUED
- Machine Learning Summary
- Microsoft Research Cambridge, public talks
- ML
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- Optics for the Cloud
- personal list
- PMRFPS's
- Required lists for MLG
- rp587
- School of Technology
- Seminar
- Simon Baker's List
- Small lecture theatre, Microsoft Research Ltd, 7 J J Thomson Avenue (Off Madingley Road), Cambridge
- Stem Cells & Regenerative Medicine
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Matthias Seeger, EPFL
Tuesday 25 September 2012, 15:00-16:00