Revisiting and re-evaluating rumour stance classification

Add to your list(s) Download to your calendar using vCal

• Carolina Scarton (University of Sheffield)
• Friday 22 January 2021, 12:00-13:00
• Virtual (Zoom).

If you have a question about this talk, please contact James Thorne.

Join Zoom Meeting https://cl-cam-ac-uk.zoom.us/j/91334942020?pwd=eDJXd09wdW1FUDMvWFBoenovMDdNUT09

Meeting ID: 913 3494 2020 Passcode: 565263

In this talk I am going to present our recent work on rumour stance classification. This task consists of automatically classifying the stance of replies to a given rumour, which has been proven to help in the verification of the rumour itself. Traditionally framed as a four-class classification problem (support, deny, query, comment), the available datasets are highly imbalanced, with a large majority of examples in the comment class. However, the two most important classes for this task are deny and support, since they express the crowd perception towards the rumour. Aiming to improve the performance of classification models in these two most important classes, we experiment with traditional feature-based as well as BERT -based approaches, using well-known techniques for dealing with data imbalance problems. In addition, we re-evaluate two widely known shared tasks on rumour stance classification, highlighting that reliable and detailed evaluation needs to be performed in order to select systems for this task.

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• NLIP Seminar Series
• PMRFPS's
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• Virtual (Zoom)
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.