University of Cambridge > Talks.cam > Machine Learning @ CUED > Natural Conjugate Gradient Learning for Fixed-Form Variational Bayes

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

Natural Conjugate Gradient Learning for Fixed-Form Variational Bayes

Download to your calendar using vCal

If you have a question about this talk, please contact Zoubin Ghahramani .

Variational Bayesian (VB) methods are typically only applied to models in the conjugate-exponential family using the variational Bayesian expectation maximisation (VB EM) algorithm or one of its variants. Here I present an efficient algorithm for applying VB to more general models. The method is based on specifying the functional form of the approximation, such as multivariate Gaussian. The parameters of the approximation are optimised using a natural conjugate gradient algorithm that utilises the Riemannian geometry of the space of the approximations. This leads to a very efficient algorithm for suitably structured approximations. It is shown empirically that the proposed method is comparable or superior in efficiency to the VB EM in a case where both are applicable. The algorithm is also applied to learning a nonlinear state-space model and a nonlinear factor analysis model for which the VB EM is not applicable. For these models, the proposed algorithm outperforms alternative gradient-based methods by a significant margin.

This is joint work with Tapani Raiko, Mikael Kuusela, Matti Tornio and Juha Karhunen.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

FW11, William Gates Building. Zoom link: https://cl-cam-ac-uk.zoom.us/j/4361570789?pwd=Nkl2T3ZLaTZwRm05bzRTOUUxY3Q4QT09&from=addon Department of Engineering - Lecture Theater 2 (Inglis Building) Peterhouse

Other talks

Fairy Tales Precarity and the economy of makeshifts: A novel argument from the census of England, 1851-1911 Peri-Operative Medicine, and Obstetrics and Gynaecology From Surrogate Solvers to PINNs and Beyond Classical Methods Title to be confirmed Clonal haematopoiesis, early detection and pre-leukemia to leukemia development
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity