Inference in Stochastic Processes

Add to your list(s) Download to your calendar using vCal

• Javier Antoran (University of Cambridge), Matthew Ashman (University of Cambridge), Stratis Markou (University of Cambridge)
• Wednesday 24 February 2021, 11:00-12:30
• https://eng-cam.zoom.us/j/86068703738?pwd=YnFleXFQOE1qR1h6Vmtwbno0LzFHdz09.

If you have a question about this talk, please contact Elre Oldewage.

In parametric models, probabilistic inference is most often approached by computing a posterior distribution over model weights. These weights are then marginalised to obtain a distribution over functions and make predictions. If our goal is solely to make good predictions, an appealing alternative is to directly perform inference over the ‘function-space’ or predictive posterior distribution of our models, without considering the posterior distribution over the weights. Using Gaussian Processes (GPs) as motivation, this talk starts by introducing a method for constructing more general stochastic processes based on combining basis functions with random weights. We discuss recent research on performing approximate inference in the function space of neural networks. Finally, we provide a brief introduction to Stochastic Differential Equations (SDEs). We discuss the connection of linear SDEs to GPs and Kalman filtering and smoothing, and present a recent method for performing inference and learning in nonlinear SDEs.

Recommended reading

1. Rasmussen & Williams, “Gaussian process for Machine Learning”, Chapter 2.2: “Function space view”, pages 13-18
2. Burt et. al. “Understanding Variational Inference in Function-Space” 2020
3. Archambeau, Cédric, et al. “Variational inference for diffusion processes.” 2008

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge University Engineering Department Talks
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• ML
• Machine Learning Reading Group
• Machine Learning Reading Group @ CUED
• Machine Learning Summary
• Quantum Matter Journal Club
• Required lists for MLG
• School of Technology
• Simon Baker's List
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• https://eng-cam.zoom.us/j/86068703738?pwd=YnFleXFQOE1qR1h6Vmtwbno0LzFHdz09
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.