University of Cambridge > Talks.cam > Cambridge University Physics Society > Energy, entropy and the physics of deep learning

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Energy, entropy and the physics of deep learning

Download to your calendar using vCal

If you have a question about this talk, please contact Akshat Pandey .

Deep learning has achieved beyond-human accuracy in a plethora of challenging tasks, ranging from image recognition to gameplay. Nonetheless, why deep learning “works” is thus far an open question. In my talk, I will argue that physical concepts such as energy and entropy allow us to explain the surprising efficacy of deep learning. I will show that stochastic gradient descent, a machine learning algorithm that is commonly used, can be mapped to the familiar physics of Brownian motion albeit with a spatially anisotropic noise that is crucial to its success. Moreover, theoretical tools used to analyse spin glasses and energy landscapes give us important insights about the structure of loss functions that are typically encountered in deep learning.

This talk is part of the Cambridge University Physics Society series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Webinar & FW11, Computer Laboratory, William Gates Building. Faculty of Education, Donald McIntyre Building, 184 Hills Road CB2 8PQ, Room 1S3 DMB Download free movies online

Other talks

Cultural evolution creates language-like structure: from humans to humpback whales and beyond Cambridge Reading Group on Reproduction: Professor Sara Brill CSAR lecture: Decarbonizing road freight (TBC) “Find him if you can!”: Havergal Brian’s The Tigers as ‘autobiopera’ Morning Break Talk TBC
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity