COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring. |

University of Cambridge > Talks.cam > Isaac Newton Institute Seminar Series > Fundamental limits of deep generative neural networks

## Fundamental limits of deep generative neural networksAdd to your list(s) Download to your calendar using vCal - Helmut Bölcskei (ETH Zürich)
- Friday 10 December 2021, 10:00-11:00
- Seminar Room 1, Newton Institute.
If you have a question about this talk, please contact nobody. MDL - Mathematics of deep learning Deep neural networks have been employed very successfully as generative models for complex natural data such as images and natural language. In practice this is realized by training deep networks so that they realize high-dimensional probability distributions by transforming simple low-dimensional distributions such as uniform or Gaussian. The aim of this talk is to develop understanding of the fundamental representational capabilities of deep generative neural networks. Specifically, we show that every d-dimensional probability distribution of bounded support can be generated through deep ReLU networks out of a 1-dimensional uniform input distribution. What is more, this is possible without incurring a cost—in terms of approximation error as measured in Wasserstein-distance—relative to generating the d-dimensional target distribution from d independent random variables. This is enabled by a space-filling approach which elicits the importance of network depth in driving the Wasserstein distance between the target distribution and its neural network approximation to zero. Finally, we show that the number of bits needed to encode the corresponding generative networks equals the fundamental limit for encoding probability distributions as dictated by quantization theory. This talk is part of the Isaac Newton Institute Seminar Series series. ## This talk is included in these lists:- All CMS events
- Featured lists
- INI info aggregator
- Isaac Newton Institute Seminar Series
- School of Physical Sciences
- Seminar Room 1, Newton Institute
- bld31
Note that ex-directory lists are not shown. |
## Other listsSocial Theory Seminars Genetics Seminar Series The Inaugural Kate Pretty Lecture## Other talksSession 1 Ends Virtual BSU seminar: "NanoSplicer: Accurate identification of splice junctions using Oxford Nanopore sequencing" CoMix Study – Social Contact Survey in the UK Life after death: evidence of dry minor-merger driven growth of massive quiescent galaxies Contacts and Behaviours during the Covid-19 Pandemic |