Incorporating Structure into NLP Models with Graph Neural Networks

Add to your list(s) Download to your calendar using vCal

• Michael Schlichtkrull (University of Cambridge)
• Friday 14 May 2021, 12:00-13:00
• Virtual (Zoom).

If you have a question about this talk, please contact Huiyuan Xie.

Many of the most interesting NLP applications require modelling various structured sources in addition to text. In this talk, I will discuss how such structured data can be incorporated into neural NLP models with graph neural networks. In the first part, I will give a brief introduction to the subject, and talk about our results on modelling knowledge bases for link prediction and question answering. I will also discuss the correspondence to transformers, along with some recent results on modelling tables for fact verification. The second part of my talk will be about interpreting what these models learn. Graph neural networks are complex and highly nonlinear models. They can help models benefit from structure, but it can be difficult to understand which structures are useful, how exactly the model uses the structure, and why specific decisions are made. I will talk about our recent work on GraphMask, an interpretability technique for graph neural networks. GraphMask produces rationales explaining which parts of a graph a given model relies on, both for individual examples and on the dataset level.

Join Zoom Meeting https://cl-cam-ac-uk.zoom.us/j/91409349297?pwd=NUVVOW5SUTNpZ2w1UkJicmhLY3MzZz09

Meeting ID: 914 0934 9297 Passcode: 612874

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• NLIP Seminar Series
• PMRFPS's
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• Virtual (Zoom)
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.