University of Cambridge > Talks.cam > Lennard-Jones Centre > Language based Pre-training for Drug Discovery

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Language based Pre-training for Drug Discovery

Download to your calendar using vCal

If you have a question about this talk, please contact Dr Christoph Schran .

Pretraining has taken the NLP world by storm as ever larger language models have broken successive benchmarks. In this talk, I’ll review some recent work applying pretraining to scientific challenges, and in particular will discuss the challenges of pretraining for molecular machine learning. I’ll introduce our new architecture, ChemBERTa, which explores the use of BERT -style pretraining for machine learning problems inspired by drug discovery applications.

This talk is part of the Lennard-Jones Centre series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Museum of Archaeology & Anthropology The Meridian Office, 54 Sidney Street Goldsmiths' 2 & https://zoom.us/j/96836714124

Other talks

Title to be confirmed Chemical strategies for biomolecule functionalisation, and biomaterial conjugation The United States of America at 250: Reflections on the Past, Present and Future of Independence Bacterial Physiology During Growth Arrest: Can It Be Targeted by Anti-Bacterial Therapeutics? When is a mummy not a mummy? Andean bodies and the problem of scientific classification in Britain The Importance of Teaching about Science and Religion in a Time of Global Uncertainty
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity