Skip to main navigation Skip to search Skip to main content

AbjadGenEval: Abjad AI Generated Text Detection Shared Task for Languages Using Arabic Script at AbjadNLP 2026

  • Saad Ezzini
  • , Irfan Ahmad
  • , Salmane Chafik
  • , Shadi Abudalfa
  • , Mo El-Haj
  • , Ahmed Abdelali
  • , Mustafa Jarrar
  • , Nadir Durrani
  • , Hassan Sajjad
  • , Farah Adeeba
  • King Fahd University of Petroleum and Minerals
  • Mohammed VI Polytechnic University
  • VinUniversity
  • Humain
  • Birzeit University
  • Dalhousie University
  • University of Engineering & Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We present the findings of the AbjadGenEval shared task, organized as part of the AbjadNLP workshop at EACL 2026, which benchmarks AI-generated text detection for Arabic-script languages. Extending beyond Arabic to include Urdu, the task serves as a binary classification platform distinguishing human-written from AI-generated news articles produced by varied LLMs (e.g., GPT, Gemini). Twenty teams participated, with top systems achieving F1 scores of 0.93 for Arabic and 0.89 for Urdu. The results highlight the dominance of multilingual transformers-specifically XLM-RoBERTa and DeBERTa-v3-and reveal significant challenges in cross-domain generalization, where naive data augmentation often yielded diminishing returns. This shared task establishes a robust baseline for authenticating content in the Abjad ecosystem.

Original languageEnglish
Title of host publicationEACL 2026 - 19th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script, AbjadNLP 2026
EditorsMo El-Haj, Mo El-Haj, Paul Rayson, Mustafa Jarrar, Ignatius Ezeani, Saad Ezzini, Sina Ahmadi, Amal Haddad Haddad, Cynthia Amol, Ahmad Abdelali, Shadi Abudalfa
PublisherAssociation for Computational Linguistics (ACL)
Pages530-537
Number of pages8
ISBN (Electronic)9798891763616
DOIs
Publication statusPublished - 28 Mar 2026
Event2nd Workshop on NLP for Languages Using Arabic Script, AbjadNLP 2026 - Rabat, Morocco
Duration: 28 Mar 2026 → …

Publication series

NameEACL 2026 - 19th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script, AbjadNLP 2026

Conference

Conference2nd Workshop on NLP for Languages Using Arabic Script, AbjadNLP 2026
Country/TerritoryMorocco
CityRabat
Period28/03/26 → …

Fingerprint

Dive into the research topics of 'AbjadGenEval: Abjad AI Generated Text Detection Shared Task for Languages Using Arabic Script at AbjadNLP 2026'. Together they form a unique fingerprint.

Cite this