Overview of the CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

被引:14
|
作者
Nakov, Preslav [1 ]
Barron-Cedeno, Alberto [2 ]
Martino, Giovanni da San [3 ]
Alam, Firoj [4 ]
Struss, Julia Maria [5 ]
Mandl, Thomas [6 ]
Miguez, Ruben [7 ]
Caselli, Tommaso [8 ]
Kutlu, Mucahid [9 ]
Zaghouani, Wajdi [10 ]
Li, Chengkai [11 ]
Shaar, Shaden [12 ]
Shahi, Gautam Kishore [13 ]
Mubarak, Hamdy [4 ]
Nikolov, Alex [14 ]
Babulkov, Nikolay [15 ]
Kartal, Yavuz Selim [16 ]
Wiegand, Michael [17 ]
Siegel, Melanie [18 ]
Kohler, Juliane [5 ]
机构
[1] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates
[2] Univ Bologna, Forli, Italy
[3] Univ Padua, Padua, Italy
[4] HBKU, Qatar Comp Res Inst, Ar Rayyan, Qatar
[5] Univ Appl Sci Potsdam, Potsdam, Germany
[6] Univ Hildesheim, Hildesheim, Germany
[7] Newtral Media Audiovisual, Madrid, Spain
[8] Univ Groningen, Groningen, Netherlands
[9] TOBB Univ Econ & Technol, Ankara, Turkey
[10] Hamad Bin Khalifa Univ, Ar Rayyan, Qatar
[11] Univ Texas Arlington, Arlington, TX 76019 USA
[12] Cornell Univ, Ithaca, NY USA
[13] Univ Duisburg Essen, Duisburg, Germany
[14] CheckStep, London, England
[15] Sofia Univ, Sofia, Bulgaria
[16] GESIS Leibniz Inst Social Sci, Mannheim, Germany
[17] Univ Klagenfurt, Klagenfurt, Austria
[18] Darmstadt Univ Appl Sci, Darmstadt, Germany
关键词
Fact-Checking; Disinformation; Misinformation; Check-Worthiness; Verified Claim Retrieval; Fake News; COVID-19;
D O I
10.1007/978-3-031-13643-6_29
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We describe the fifth edition of the CheckThat! lab, part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality in multiple languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 asks to identify relevant claims in tweets in terms of check-worthiness, verifiability, harmfullness, and attention-worthiness. Task 2 asks to detect previously fact-checked claims that could be relevant to fact-check a new claim. It targets both tweets and political debates/speeches. Task 3 asks to predict the veracity of the main claim in a news article. CheckThat! was the most popular lab at CLEF-2022 in terms of team registrations: 137 teams. More than one-third (37%) of them actually participated: 18, 7, and 26 teams submitted 210, 37, and 126 official runs for tasks 1, 2, and 3, respectively.
引用
收藏
页码:495 / 520
页数:26
相关论文
共 50 条
  • [21] Detection of Fake News on COVID-19 on Web Search Engines
    Mazzeo, Valeria
    Rapisarda, Andrea
    Giuffrida, Giovanni
    FRONTIERS IN PHYSICS, 2021, 9
  • [22] Detection of fake news on COVID-19 on web search engines
    Mazzeo, Valeria
    Rapisarda, A.
    Giuffrida, G.
    arXiv, 2021,
  • [23] Cross-lingual COVID-19 Fake News Detection
    Du, Jiangshu
    Dou, Yingtong
    Xia, Congying
    Cui, Limeng
    Ma, Jing
    Yu, Philip S.
    21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS ICDMW 2021, 2021, : 859 - 862
  • [24] Fake news in COVID-19: A perspective
    Carrion-Alvarez, Diego
    Tijerina-Salina, Perla X.
    HEALTH PROMOTION PERSPECTIVES, 2020, 10 (04): : 290 - 291
  • [25] COVID-19 Fake News Detector
    Liu, Junjie
    Chen, Min
    2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 463 - 467
  • [26] Fighting fake news in the COVID-19 era: policy insights from an equilibrium model
    Kris Hartley
    Minh Khuong Vu
    Policy Sciences, 2020, 53 : 735 - 758
  • [27] Fighting fake news in the COVID-19 era: policy insights from an equilibrium model
    Hartley, Kris
    Khuong, Vu Minh
    POLICY SCIENCES, 2020, 53 (04) : 735 - 758
  • [28] COVID-19 INFODEMIC - UNDERSTANDING CONTENT FEATURES IN DETECTING FAKE NEWS USING A MACHINE LEARNING APPROACH
    Balakrishnan, Vimala
    Zing, Hii Lee
    Laporte, Eric
    MALAYSIAN JOURNAL OF COMPUTER SCIENCE, 2023, 36 (01) : 1 - 13
  • [29] The Crisis of Public Health and Infodemic: Analyzing Belief Structure of Fake News about COVID-19 Pandemic
    Kim, Seoyong
    Kim, Sunhee
    SUSTAINABILITY, 2020, 12 (23) : 1 - 23
  • [30] Managing News Overload (MNO): The COVID-19 Infodemic
    Ahmed, Sameera Tahira
    INFORMATION, 2020, 11 (08)