|COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring.|
Sparsity: Beyond L1
If you have a question about this talk, please contact Colorado Reed.
The L1 norm is a popular choice of regularizer when learning a mapping from inputs to outputs under a frequentist framework. This norm has the useful property of being convex and promoting sparsity. Sparse solutions are desirable when you believe that only a subset of the input features are required to generate an output e.g. when the input dimension is much larger than the number of data points. A significant body of research is dedicated to studying when such regularizers work and where they do not. These ideas can be extended to group or structured sparsity, which can be used to sparse multi kernel learning and non-linear variable selection. Finally we shall discuss sparse matrices developed by generalizing the L1 norm in particular ways, including sparse PCA and dictionary learning.
This talk is part of the Machine Learning Reading Group @ CUED series.
This talk is included in these lists:
Note that ex-directory lists are not shown.
Other listsPart III Seminar Series Michaelmas 2012 Cambridge Initiative For Musculoskeletal Tissue Engineering Inaugural Meeting DAMTP Fluids Talks
Other talksThe Bayesian Approach to Inverse Problems Self-organisation of pluripotent cells in the mouse embryo X-rayed maize and mutant marigolds: a history of early plant biotechnologies The properties of silica glass relevant to their use in ballistics applications Sequential Monte Carlo methods for applications in Data Assimilation Waiting for Emancipation: The Prospects for Liberal Revolution and a Human Economy in Africa