Overview of the CLEF-2022 CheckThat! Lab Task 2 on Detecting Previously Fact-Checked Claims
2022 Conference and Labs of the Evaluation Forum, CLEF 2022
; 3180:393-403, 2022.
Article
in English
| Scopus | ID: covidwho-2012124
ABSTRACT
We describe the fourth edition of the CheckThat! Lab, part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting three tasks related to factuality, and it covers seven languages such as Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Here, we present the task 2, which asks to detect previously fact-checked claims (in two languages). A total of six teams participated in this task, submitted a total of 37 runs, and most submissions managed to achieve sizable improvements over the baselines using transformer based models such as BERT, RoBERTa. In this paper, we describe the process of data collection and the task setup, including the evaluation measures, and we give a brief overview of the participating systems. Last but not least, we release to the research community all datasets from the lab as well as the evaluation scripts, which should enable further research in detecting previously fact-checked claims. © 2022 Copyright for this paper by its authors.
Check-Worthiness Estimation; Computational Journalism; COVID-19; Detecting Previously Fact-Checked Claims; Fact-Checking; Social Media Verification; Veracity; Verified Claims Retrieval; Laboratories; Data collection; Detecting previously fact-checked claim; Social media; Social medium verification; Turkishs; Verified claim retrieval
Search on Google
Collection:
Databases of international organizations
Database:
Scopus
Language:
English
Journal:
2022 Conference and Labs of the Evaluation Forum, CLEF 2022
Year:
2022
Document Type:
Article
Similar
MEDLINE
...
LILACS
LIS