MDL Reading Group
- π€ Speaker: Alexandru Cioba (MediaTek Research)
- π Date & Time: Monday 01 November 2021, 14:00 - 15:00
- π Venue: Seminar Room 1, Newton Institute
Abstract
I will present the paper “A mean field limit for certain deep neural networks” by DYEGO ARA ÚJO, ROBERTO I . OLIVEIRA & DANIEL YUKIMURA .
I recent years, increased attention has been paid to DNNs with high numbers of parameters, after observations that the classical bias-variance tradeoff principle fails to paint an accurate picture of the behaviour of NNs as the dimension of their parameter space tends to infinity. This motivated several lines of reasearch into the limiting behaviour of NNs under various scaling frameworks.
The paper above presents a self contained and intuitive description of this phenomenon. I’ll try to shine some light under the complex notation and to explain the major ideas behind the results.
Series This talk is part of the Isaac Newton Institute Seminar Series series.
Included in Lists
- All CMS events
- bld31
- dh539
- Featured lists
- INI info aggregator
- Isaac Newton Institute Seminar Series
- School of Physical Sciences
- Seminar Room 1, Newton Institute
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Alexandru Cioba (MediaTek Research)
Monday 01 November 2021, 14:00-15:00