Efficiency and Transferability of Neural Networks

Add to your list(s) Download to your calendar using vCal

• Amos Storkey, School of Informatics, University of Edinburgh
• Friday 12 July 2019, 11:00-12:00
• Engineering Department, CBL Room BE-438..

If you have a question about this talk, please contact Robert Peharz.

Neural Networks are expensive tools for doing very specific tasks. The computational costs of neural network use hinder deployment on embedded devices for time-sensitive tasks, and the costs of learning are substantial in all settings. At the same time, neural network learning is overly dependent on large labelled training dataset that directly matches the test time task, and by default transfers poorly to slight perturbations of task.

In this talk I will explore a number of investigations in the efficiency and transferability of neural networks; we demonstrate that pruning is typically ineffective, but structured replacement can work well. We show that full pipeline optimization to hardware can provide substantial benefit. At the same time we explore how meta learning approaches can be adapted for transductive learning, by learning to learn unsupervised loss functions.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

• Seminar
• All Talks (aka the CURE list)
• Biology
• CBL important
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Neuroscience Seminars
• Cambridge talks
• Chris Davis' list
• Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
• Engineering Department, CBL Room BE-438.
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ML
• Machine Learning @ CUED
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• Simon Baker's List
• Stem Cells & Regenerative Medicine
• Trust & Technology Initiative - interesting events
• bld31
• dh539
• kt532's list
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.