Overview of the CLEF-2023 CheckThat! Lab Task 4 on Factuality of Reporting of News Media

Preslav Nakov*, Firoj Alam*, Giovanni Da San Martino, Maram Hasanain, Dilshod Azizov, Rabindra Nath Nandi, Panayotov Panayot

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

Abstract

We present an overview of the CLEF-2023 CheckThat! lab Task 4, which focused on predicting the factuality of reporting of entire news outlets. This is a different level of granularity compared to previous efforts, which focused on fact-checking, where the target is a claim, or fake news detection, where the target is an article. We briefly summarize the participating systems and discuss the dataset, the task, and the evaluation setup. The task attracted a large number of registrations, and eventually five teams made submissions. All participants improved over the baseline by a margin using both deep learning and traditional machine learning approaches. We make the dataset and the associate code freely available to the research community with the aim to promote further research on this problem.

Original languageEnglish
Pages (from-to)260-268
Number of pages9
JournalCEUR Workshop Proceedings
Volume3497
Publication statusPublished - 2023
Event24th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF-WN 2023 - Thessaloniki, Greece
Duration: 18 Sept 202321 Sept 2023

Keywords

  • factuality
  • news media
  • veracity

Fingerprint

Dive into the research topics of 'Overview of the CLEF-2023 CheckThat! Lab Task 4 on Factuality of Reporting of News Media'. Together they form a unique fingerprint.

Cite this