An Introduction to In-Context Learning
- đ¤ Speaker: Juyeon Heo, John Bronskill, University of Cambridge
- đ Date & Time: Wednesday 19 March 2025, 11:00 - 12:30
- đ Venue: Cambridge University Engineering Department, CBL Seminar room BE4-38.
Abstract
In-context learning (ICL) has emerged as a powerful capability of large language models (LLMs), allowing them to adapt to new tasks without explicit parameter updates. This talk begins with an introduction to meta-learning and neural processes, which lay the foundation for ICL . We then move on to transformer based ICL where the model can be trained from scratch or leverage pre-trained LLMs. To attempt to understand why ICL works, we discuss its connections to Bayesian inference, kernel regression, and gradient descent. Finally, we examine potential safety concerns in ICL , highlighting risks and challenges in reliable AI deployment.
Series This talk is part of the Machine Learning Reading Group @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Cambridge University Engineering Department, CBL Seminar room BE4-38.
- Cambridge University Engineering Department Talks
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- custom
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Machine Learning Reading Group
- Machine Learning Reading Group @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- ob366-ai4er
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- School of Technology
- Simon Baker's List
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Juyeon Heo, John Bronskill, University of Cambridge
Wednesday 19 March 2025, 11:00-12:30