An Introduction to Transformer Neural Processes
- 👤 Speaker: Matt Ashman and Cristiana Diaconu
- 📅 Date & Time: Wednesday 28 February 2024, 11:00 - 12:30
- 📍 Venue: Cambridge University Engineering Department, CBL Seminar room BE4-38.
Abstract
Neural processes (NPs) have significantly improved since their inception. A principal factor in their effectiveness has been advancements in the architecture of permutation-invariant set functions—a notable example of which being transformer-based architectures. In this reading group session, we will introduce participants to Transformer Neural Processes (TNPs). We do not assume prior knowledge of NPs or transformers.
Useful background reading: 1) Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelling. Nguyen and Grover (2022). https://arxiv.org/abs/2207.04179 2) Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks. Lee et al. (2018). https://arxiv.org/abs/1810.00825 3) Latent Bottlenecked Attentive Neural Processes. Feng et al. (2022). https://arxiv.org/abs/2211.08458 4) Attentive Neural Processes. Kim et al. (2019). https://arxiv.org/abs/1901.05761.
Series This talk is part of the Machine Learning Reading Group @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge talks
- Cambridge University Engineering Department, CBL Seminar room BE4-38.
- Cambridge University Engineering Department Talks
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- custom
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Machine Learning Reading Group
- Machine Learning Reading Group @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- ob366-ai4er
- Quantum Matter Journal Club
- Required lists for MLG
- rp587
- School of Technology
- Simon Baker's List
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)

Matt Ashman and Cristiana Diaconu
Wednesday 28 February 2024, 11:00-12:30