Overview of the CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

被引：14

作者：

Nakov, Preslav ^{[1
]}

Barron-Cedeno, Alberto ^{[2
]}

Martino, Giovanni da San ^{[3
]}

Alam, Firoj ^{[4
]}

Struss, Julia Maria ^{[5
]}

Mandl, Thomas ^{[6
]}

Miguez, Ruben ^{[7
]}

Caselli, Tommaso ^{[8
]}

Kutlu, Mucahid ^{[9
]}

Zaghouani, Wajdi ^{[10
]}

Li, Chengkai ^{[11
]}

Shaar, Shaden ^{[12
]}

Shahi, Gautam Kishore ^{[13
]}

Mubarak, Hamdy ^{[4
]}

Nikolov, Alex ^{[14
]}

Babulkov, Nikolay ^{[15
]}

Kartal, Yavuz Selim ^{[16
]}

Wiegand, Michael ^{[17
]}

Siegel, Melanie ^{[18
]}

Kohler, Juliane ^{[5
]}

机构：

[1] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates

[2] Univ Bologna, Forli, Italy

[3] Univ Padua, Padua, Italy

[4] HBKU, Qatar Comp Res Inst, Ar Rayyan, Qatar

[5] Univ Appl Sci Potsdam, Potsdam, Germany

[6] Univ Hildesheim, Hildesheim, Germany

[7] Newtral Media Audiovisual, Madrid, Spain

[8] Univ Groningen, Groningen, Netherlands

[9] TOBB Univ Econ & Technol, Ankara, Turkey

[10] Hamad Bin Khalifa Univ, Ar Rayyan, Qatar

[11] Univ Texas Arlington, Arlington, TX 76019 USA

[12] Cornell Univ, Ithaca, NY USA

[13] Univ Duisburg Essen, Duisburg, Germany

[14] CheckStep, London, England

[15] Sofia Univ, Sofia, Bulgaria

[16] GESIS Leibniz Inst Social Sci, Mannheim, Germany

[17] Univ Klagenfurt, Klagenfurt, Austria

[18] Darmstadt Univ Appl Sci, Darmstadt, Germany

来源：

EXPERIMENTAL IR MEETS MULTILINGUALITY, MULTIMODALITY, AND INTERACTION (CLEF 2022) | 2022年 / 13390卷

关键词：

Fact-Checking; Disinformation; Misinformation; Check-Worthiness; Verified Claim Retrieval; Fake News; COVID-19;

D O I：

10.1007/978-3-031-13643-6_29

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We describe the fifth edition of the CheckThat! lab, part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality in multiple languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 asks to identify relevant claims in tweets in terms of check-worthiness, verifiability, harmfullness, and attention-worthiness. Task 2 asks to detect previously fact-checked claims that could be relevant to fact-check a new claim. It targets both tweets and political debates/speeches. Task 3 asks to predict the veracity of the main claim in a news article. CheckThat! was the most popular lab at CLEF-2022 in terms of team registrations: 137 teams. More than one-third (37%) of them actually participated: 18, 7, and 26 teams submitted 210, 37, and 126 official runs for tasks 1, 2, and 3, respectively.

引用

页码：495 / 520

页数：26

共 50 条

[1] The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection
Nakov, Preslav
Barron-Cedeno, Alberto
Martino, Giovanni Da San
Alam, Firoj
Struss, Julia Maria
Mandl, Thomas
Miguez, Ruben
Caselli, Tommaso
Kutlu, Mucahid
Zaghouani, Wajdi
Li, Chengkai
Shaar, Shaden
Shahi, Gautam Kishore
Mubarak, Hamdy
Nikolov, Alex
Babulkov, Nikolay
Kartal, Yavuz Selim
Beltran, Javier
ADVANCES IN INFORMATION RETRIEVAL, PT II, 2022, 13186 : 416 - 428
[2] COVID-19 Infodemic in Malaysia: Conceptualizing Fake News for Detection
Lim, Chee Kuan
Zainol, Zurinahni
Omar, Bahiyah
Ibrahim, Noor Farizah
ADVANCES IN MULTIMEDIA, 2023, 2023
[3] COVID-19 Vaccination Campaign: Fake News Infodemic
Neto, Mercedes
Ferreira Lachtim, Sheila Aparecida
REVISTA BRASILEIRA DE ENFERMAGEM, 2022, 75 (04)
[4] Regulation of COVID-19 fake news infodemic in China and India
Rodrigues, Usha M.
Xu, Jian
MEDIA INTERNATIONAL AUSTRALIA, 2020, 177 (01) : 125 - 131
[5] Infodemic and Fake News in Spain during the COVID-19 Pandemic
Fernandez-Torres, Maria Jesus
Almansa-Martinez, Ana
Chamizo-Sanchez, Rocio
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2021, 18 (04) : 1 - 13
[6] Selective Feature Sets Based Fake News Detection for COVID-19 to Manage Infodemic
Narra, Manideep
Umer, Muhammad
Sadiq, Saima
Eshmawi, Ala' Abdulmajid
Karamti, Hanen
Mohamed, Abdullah
Ashraf, Imran
IEEE ACCESS, 2022, 10 : 98724 - 98736
[7] Selective Feature Sets Based Fake News Detection for COVID-19 to Manage Infodemic
Narra, Manideep
Umer, Muhammad
Sadiq, Saima
Eshmawi, Ala Abdulmajid
Karamti, Hanen
Mohamed, Abdullah
Ashraf, Imran
IEEE Access, 2022, 10 : 98724 - 98736
[8] Fake News, Real Emotions: Emotion Analysis of COVID-19 Infodemic in Weibo
Wan, Mingyu
Zhong, Yin
Gao, Xuefeng
Lee, Yat Mei
Huang, Chu-Ren
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (03) : 815 - 827
[9] Covid-19 Fake News Detection: A Survey
Shushkevich, Elena
Alexandrov, Mikhail
Cardiff, John
COMPUTACION Y SISTEMAS, 2021, 25 (04): : 783 - 792
[10] Infodemic and the spread of fake news in the COVID-19-era
Orso, Daniele
Federici, Nicola
Copetti, Roberto
Vetrugno, Luigi
Bove, Tiziana
EUROPEAN JOURNAL OF EMERGENCY MEDICINE, 2020, 27 (05) : 327 - 328

← 1 2 3 4 5 →