Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques

Jakub Piskorski; Nicolas Stefanovitch; Firoj Alam; Ricardo Campos; Dimitar Dimitrov; Alípio Jorge; Senja Pollak; Nikolay Ribin; Zoran Fijavž; Maram Hasanain; Purificação Silvano; Elisa Sartori; Nuno Guimarães; Ana Zwitter Vitez; Ana Filipa Pacheco; Ivan Koychev; Nana Yu; Preslav Nakov; Giovanni Da San Martino

Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques

Jakub Piskorski^*
, Nicolas Stefanovitch
, Firoj Alam
, Ricardo Campos
, Dimitar Dimitrov
, Alípio Jorge
, Senja Pollak
, Nikolay Ribin
, Zoran Fijavž
, Maram Hasanain
, Purificação Silvano
, Elisa Sartori
, Nuno Guimarães
, Ana Zwitter Vitez
, Ana Filipa Pacheco
, Ivan Koychev
, Nana Yu
, Preslav Nakov
, Giovanni Da San Martino

^*Corresponding author for this work

Polish Academy of Sciences
European Commission Joint Research Centre Institute
Universidade Do Porto
University of Beira Interior
Sofia University St. Kliment Ohridski
University of Porto
Jožef Stefan Institute
Peace Institute
CLUP
University of Padua
University of Ljubljana
Mohamed Bin Zayed University of Artificial Intelligence

Research output: Contribution to journal › Conference article › peer-review

1 Citation (Scopus)

Abstract

We present an overview of CheckThat! Lab's 2024 Task 3, which focuses on detecting 23 persuasion techniques at the text-span level in online media. The task covers five languages, namely, Arabic, Bulgarian, English, Portuguese, and Slovene, and highly-debated topics in the media, e.g., the Isreali-Palestian conflict, the Russia-Ukraine war, climate change, COVID-19, abortion, etc. A total of 23 teams registered for the task, and two of them submitted system responses which were compared against a baseline and a task organizers' system, which used a state-of-the-art transformer-based architecture. We provide a description of the dataset and the overall task setup, including the evaluation methodology, and an overview of the participating systems. The datasets accompanied with the evaluation scripts are released to the research community, which we believe will foster research on persuasion technique detection and analysis of online media content in various fields and contexts.

Original language	English
Pages (from-to)	299-310
Number of pages	12
Journal	CEUR Workshop Proceedings
Volume	3740
Publication status	Published - 12 Sept 2024
Event	25th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2024 - Grenoble, France Duration: 9 Sept 2024 → 12 Sept 2024

Keywords

Persuasion technique
media analysis
multilinguality

Cite this

Piskorski, J., Stefanovitch, N., Alam, F., Campos, R., Dimitrov, D., Jorge, A., Pollak, S., Ribin, N., Fijavž, Z., Hasanain, M., Silvano, P., Sartori, E., Guimarães, N., Vitez, A. Z., Pacheco, A. F., Koychev, I., Yu, N., Nakov, P., & Da San Martino, G. (2024). Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques. CEUR Workshop Proceedings, 3740, 299-310.

@article{d104b54cd7f3450792cb7c37a72595cc,

title = "Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques",

abstract = "We present an overview of CheckThat! Lab's 2024 Task 3, which focuses on detecting 23 persuasion techniques at the text-span level in online media. The task covers five languages, namely, Arabic, Bulgarian, English, Portuguese, and Slovene, and highly-debated topics in the media, e.g., the Isreali-Palestian conflict, the Russia-Ukraine war, climate change, COVID-19, abortion, etc. A total of 23 teams registered for the task, and two of them submitted system responses which were compared against a baseline and a task organizers' system, which used a state-of-the-art transformer-based architecture. We provide a description of the dataset and the overall task setup, including the evaluation methodology, and an overview of the participating systems. The datasets accompanied with the evaluation scripts are released to the research community, which we believe will foster research on persuasion technique detection and analysis of online media content in various fields and contexts.",

keywords = "Persuasion technique, media analysis, multilinguality",

author = "Jakub Piskorski and Nicolas Stefanovitch and Firoj Alam and Ricardo Campos and Dimitar Dimitrov and Al{\'i}pio Jorge and Senja Pollak and Nikolay Ribin and Zoran Fijav{\v z} and Maram Hasanain and Purifica{\c c}{\~a}o Silvano and Elisa Sartori and Nuno Guimar{\~a}es and Vitez, \{Ana Zwitter\} and Pacheco, \{Ana Filipa\} and Ivan Koychev and Nana Yu and Preslav Nakov and \{Da San Martino\}, Giovanni",

note = "Publisher Copyright: {\textcopyright} 2024 Copyright for this paper by its authors.; 25th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2024 ; Conference date: 09-09-2024 Through 12-09-2024",

year = "2024",

month = sep,

day = "12",

language = "English",

volume = "3740",

pages = "299--310",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "CEUR-WS",

}

TY - JOUR

T1 - Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques

AU - Piskorski, Jakub

AU - Stefanovitch, Nicolas

AU - Alam, Firoj

AU - Campos, Ricardo

AU - Dimitrov, Dimitar

AU - Jorge, Alípio

AU - Pollak, Senja

AU - Ribin, Nikolay

AU - Fijavž, Zoran

AU - Hasanain, Maram

AU - Silvano, Purificação

AU - Sartori, Elisa

AU - Guimarães, Nuno

AU - Vitez, Ana Zwitter

AU - Pacheco, Ana Filipa

AU - Koychev, Ivan

AU - Yu, Nana

AU - Nakov, Preslav

AU - Da San Martino, Giovanni

PY - 2024/9/12

Y1 - 2024/9/12

N2 - We present an overview of CheckThat! Lab's 2024 Task 3, which focuses on detecting 23 persuasion techniques at the text-span level in online media. The task covers five languages, namely, Arabic, Bulgarian, English, Portuguese, and Slovene, and highly-debated topics in the media, e.g., the Isreali-Palestian conflict, the Russia-Ukraine war, climate change, COVID-19, abortion, etc. A total of 23 teams registered for the task, and two of them submitted system responses which were compared against a baseline and a task organizers' system, which used a state-of-the-art transformer-based architecture. We provide a description of the dataset and the overall task setup, including the evaluation methodology, and an overview of the participating systems. The datasets accompanied with the evaluation scripts are released to the research community, which we believe will foster research on persuasion technique detection and analysis of online media content in various fields and contexts.

AB - We present an overview of CheckThat! Lab's 2024 Task 3, which focuses on detecting 23 persuasion techniques at the text-span level in online media. The task covers five languages, namely, Arabic, Bulgarian, English, Portuguese, and Slovene, and highly-debated topics in the media, e.g., the Isreali-Palestian conflict, the Russia-Ukraine war, climate change, COVID-19, abortion, etc. A total of 23 teams registered for the task, and two of them submitted system responses which were compared against a baseline and a task organizers' system, which used a state-of-the-art transformer-based architecture. We provide a description of the dataset and the overall task setup, including the evaluation methodology, and an overview of the participating systems. The datasets accompanied with the evaluation scripts are released to the research community, which we believe will foster research on persuasion technique detection and analysis of online media content in various fields and contexts.

KW - Persuasion technique

KW - media analysis

KW - multilinguality

UR - https://www.scopus.com/pages/publications/85201601949

M3 - Conference article

AN - SCOPUS:85201601949

SN - 1613-0073

VL - 3740

SP - 299

EP - 310

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

T2 - 25th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2024

Y2 - 9 September 2024 through 12 September 2024

ER -

Overview of the CLEF-2024 CheckThat! Lab Task 3 on Persuasion Techniques

Abstract

Keywords

Other files and links

Fingerprint

Cite this