Diffusion and Score-based Generative Models

Add to your list(s) Download to your calendar using vCal

• Vincent Dutordoir, Wenlin Chen, Tor Fjelde (University of Cambridge)
• Wednesday 19 January 2022, 11:00-12:30
• Cambridge University Engineering Department, LR12.

If you have a question about this talk, please contact Elre Oldewage.

Abstract

Score-based generative models have recently shown impressive results in generating synthetic data from complex distributions — becoming a promising alternative to GANs for sampling photorealistic images. The key idea in these models is to reverse an MCMC chain in which a white noise sample is gradually denoised to obtain a sample from the target density. During training, the score functions (gradients of log probability density functions) on a large number of noise-perturbed data distributions is learned — hence, the name of the model. In this reading group, we cover the basics and advantages of score-based generative models, their connections to SDEs and the link with diffusion-based models.

Recommended reading

- Deep Unsupervised Learning using Nonequilibrium Thermodynamics. Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan, Surya Ganguli. ICML 2015 . [Required]

- Denoising Diffusion Probabilistic Models. Jonathan Ho, Ajay Jain, Pieter Abbeel. NeurIPS 2020. [Optional] - Generative Modeling by Estimating Gradients of the Data Distribution. Yang Song, Stefano Ermon. NeurIPS 2019. [Required]

- Score-Based Generative Modeling through Stochastic Differential Equations, Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, Ben Poole. ICLR 2021 . [Optional]

Our reading groups are livestreamed via Zoom and recorded for our Youtube channel. The Zoom details are distributed via our weekly mailing list.

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

• Cambridge University Engineering Department, LR12
• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge University Engineering Department Talks
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• ML
• Machine Learning Reading Group
• Machine Learning Reading Group @ CUED
• Machine Learning Summary
• Quantum Matter Journal Club
• Required lists for MLG
• School of Technology
• Simon Baker's List
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.