University of Cambridge > Talks.cam > Machine Learning Reading Group @ CUED > Natural gradient descent and variational inference

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

Natural gradient descent and variational inference

Download to your calendar using vCal

If you have a question about this talk, please contact Yingzhen Li .

We will cover the following topics, time allowing.

1) Knuth covariance 2) A short introduction to Riemannian geometry. 3) The elegant properties of the Fisher-Rao metric and the connection to the VB update. 4) The paper “Approximate Riemannian Conjugate Gradient Learning for Fixed-Form Variational Bayes” JMLR 2010 . Honkela, Raiko, Kuusela, Tornio, Karhunen. 5) The paper “Stochastic variational inference” JMLR 2013 Hoffman, Blei, Wang, Paisley. 6) Time allowing. The paper “Gaussian processes for Big Data” Hensman, Fusi, Lawrence.

There is no need to do background reading, but those wanting to get a flavour of the talk should look at the natural gradient parts of 4) and 5).

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Wolfson Lecture Theatre, Dept. of Chemistry & Zoom Centre for Mathematical Sciences, MR21 Linnett Room, Robinson College

Other talks

Illegal trade in the North Atlantic On convective penetration of a buoyant plume into a stably stratified layer Group Work Group Presentation 4 Psychiatry and Pain Medicine TBC
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity