Sampling as Optimization
- đ¤ Speaker: Eric Nalisnick, University of Cambridge
- đ Date & Time: Wednesday 03 April 2019, 13:45 - 15:15
- đ Venue: Engineering Department, CBL Room BE-438
Abstract
Sampling and optimization are often thought of as alternative methods for model fitting. In this meeting of the reading group, we summarize recent results that draw connections between sampling and optimization. The key result is the work of Jordan et al. (1998), which shows that the gradient flow of the Kullback-Leibler divergence in the space of measures follows the Fokker-Planck equation. This Fokker-Planck equation can then be recast as running Langevin dynamics in the space of model parameters. With this result established, we then discuss implications for discretization schemes, viewing SGD as approximate Bayesian inference, and models for which sampling can be faster than optimization.
Series This talk is part of the Machine Learning Reading Group @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Cambridge University Engineering Department Talks
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- custom
- Engineering Department, CBL Room BE-438
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Machine Learning Reading Group
- Machine Learning Reading Group @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- ob366-ai4er
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- School of Technology
- Simon Baker's List
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)


Wednesday 03 April 2019, 13:45-15:15