Linguistic Yardsticks: Evaluating Language Technology Using Insights from Linguistic Theory

Add to your list(s) Download to your calendar using vCal

• Laura Rimell (DeepMind)
• Tuesday 21 November 2017, 16:45-17:15
• Cripps Court, Magdalene College.

If you have a question about this talk, please contact Guy Edward Toh Emerson.

Registration required

Language technology has achieved remarkable success on practical tasks, such as machine translation and sentiment analysis, while incorporating very little theoretical linguistic knowledge. However, the appearance of success may be deceiving, because standard evaluation metrics for language technology under-represent relatively rare but linguistically interesting phenomena. Poor performance in these areas will be increasingly noticeable as technology advances and users expect more human-like behaviour. I will describe work that evaluates language technology using linguistic yardsticks: datasets designed to focus on specific phenomena, such as the semantic understanding of relative clauses, and I will consider how they may point the way toward improvements in natural language processing.

This talk is part of the Cambridge Language Sciences Annual Symposium series.

This talk is included in these lists:

• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Language Sciences Annual Symposium
• Cambridge talks
• Chris Davis' list
• Cripps Court, Magdalene College
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.