Overview of the CLEF-2025 CheckThat! Lab Task 3 on Fact-Checking Numerical Claims

V. Venktesh*, Vinay Setty, Avishek Anand, Boushra Bendou, Maram Hasanain, Houda Bouamor, Gabriel Iturra-Bocaz, Petra Galuščáková, Firoj Alam

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

Abstract

We present an overview of the CheckThat! Lab 2025 Task 3, part of CLEF 2025. The task focuses on verifying claims with numerical quantities and temporal expressions. Numerical claims are defined as those requiring validation of explicit or implicit quantitative or temporal details. It is conducted in three languages: Arabic, Spanish, and English. A total of 258 valid runs were submitted by 13 unique teams across languages, with 4 participants in Spanish and Arabic. 10 teams participated in fact-checking English numerical claims. Among these teams, the use of transformer pre-trained language models (PLMs) was the most frequent. A few teams also employed Large Language Models (LLMs). We provide a description of the dataset, the task setup, including evaluation settings, and a brief overview of the participating systems. As is customary in the CheckThat! Lab, we release all the datasets as well as the evaluation scripts to the research community. This will enable further research on identifying challenges with fact-checking numerical claims that can assist various stakeholders, such as fact-checkers, financial research analysts, and policymakers.

Original languageEnglish
Pages (from-to)709-721
Number of pages13
JournalCEUR Workshop Proceedings
Volume4038
Publication statusPublished - 2025
Event26th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2025 - Madrid, Spain
Duration: 9 Sept 202512 Sept 2025

Fingerprint

Dive into the research topics of 'Overview of the CLEF-2025 CheckThat! Lab Task 3 on Fact-Checking Numerical Claims'. Together they form a unique fingerprint.

Cite this