Parameter estimation in deep learning architectures: Two new insights.
- đ¤ Speaker: Prof. Nando de Freitas (Oxford) đ Website
- đ Date & Time: Friday 28 February 2014, 12:00 - 13:00
- đ Venue: Cambridge University Engineering Department, LR6
Abstract
The talk has two new insights. First, I will show that it is possible to train most deep learning approaches -regardless of the choice of regularization, architecture, algorithms and datasets – by learning only a small number of the parameters and predicting the rest with nonparametric methods. Often, this approach makes it possible to learn only 10% of the parameters without a drop in accuracy. Second, I will introduce a new method (LAP) for parameter estimation in loopy undirected probabilistic graphical models, also known as Markov random fields, that is linear in the number of cliques, embarrassingly parallel, data efficient, and statistically efficient.
Series This talk is part of the Machine Learning @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge Neuroscience Seminars
- Cambridge talks
- Cambridge University Engineering Department, LR6
- CBL important
- Chris Davis' list
- Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Joint Machine Learning Seminars
- Life Science
- Life Sciences
- Machine Learning @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- Required lists for MLG
- rp587
- Seminar
- Simon Baker's List
- Stem Cells & Regenerative Medicine
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)



Friday 28 February 2014, 12:00-13:00