University of Cambridge > Talks.cam > Machine Learning Reading Group @ CUED > Self-Supervised Representation Learning

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹī¸ Information

Self-Supervised Representation Learning

Download to your calendar using vCal

If you have a question about this talk, please contact .

Self-Supervised Learning (SSL), combined with deep neural network models, has seen great success recently. Representations learnt with SSL have been used to obtain state-of-the-art results on imagenet as well as text and speech classification tasks. We begin by introducing SSL , focusing on two of the most successful approaches: contrastive predictive coding (CPC) and deep InfoMax (DIM). We provide information theoretic interpretations of these approaches, and discuss the role of mutual information as a principal motivator for this framework. Next, we consider the role of identifiability in representation learning with generative models. We discuss recent results demonstrating that seemingly heuristic SSL approaches can be used to guarantee identifiability in nonlinear-ICA. These results imply an interesting link between identifiable generative models and SSL , potentially providing a principled foundation for SSL approaches.

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Senior Palrour, Gonville & Caius College Seminar Room 2, Clinical School, Addenbrookes Hospital, Cambridge. Healey Room, Westminster College

Other talks

Task performance predicts the substitution of feedforward by feedback drive in visual cortex Wolfson Tool Factory Morning Break Loke CTR Annual Meeting 2026 - Epigenetics of embryogenesis and placentation Good and Evil Plasma Cells: Guardians & Saboteurs of Immunity Grand Rounds - Equine
 

Š 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity