Parameter estimation in deep learning architectures: Two new insights.

Add to your list(s) Download to your calendar using vCal

• Prof. Nando de Freitas (Oxford)
• Friday 28 February 2014, 12:00-13:00
• Cambridge University Engineering Department, LR6.

If you have a question about this talk, please contact Zoubin Ghahramani.

Note: time is 12 noon (*not* 11am)

The talk has two new insights. First, I will show that it is possible to train most deep learning approaches -regardless of the choice of regularization, architecture, algorithms and datasets – by learning only a small number of the parameters and predicting the rest with nonparametric methods. Often, this approach makes it possible to learn only 10% of the parameters without a drop in accuracy. Second, I will introduce a new method (LAP) for parameter estimation in loopy undirected probabilistic graphical models, also known as Markov random fields, that is linear in the number of cliques, embarrassingly parallel, data efficient, and statistically efficient.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

• Cambridge University Engineering Department, LR6
• Seminar
• All Talks (aka the CURE list)
• Biology
• CBL important
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Neuroscience Seminars
• Cambridge talks
• Chris Davis' list
• Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ML
• Machine Learning @ CUED
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• Simon Baker's List
• Stem Cells & Regenerative Medicine
• Trust & Technology Initiative - interesting events
• bld31
• dh539
• kt532's list
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.