Pearl: A Multimodal Culturally-Aware Arabic Instruction Dataset

  • Fakhraddin Alwajih
  • , Samar M. Magdy
  • , Abdellah El Mekki
  • , Omer Nacar
  • , Youssef Nafea
  • , Safaa Taher Abdelfadil
  • , Abdulfattah Mohammed Yahya
  • , Hamzah Luqman
  • , Nada Almarwani
  • , Samah Aloufi
  • , Baraah Qawasmeh
  • , Houdaifa Atou
  • , Serry Sibaee
  • , Hamzah A. Alsayadi
  • , Walid Al-Dhabyani
  • , Maged S. Al-Shaibani
  • , Aya El Aatar
  • , Nour Qandos
  • , Rahaf Alhamouri
  • , Samar Ahmad
  • Mohammed Anwar Al-Ghrawi, Aminetou Yacoub, Ruwa AbuHweidi, Vatimetou Mohamed Lemin, Reem Abdel-Salam, Ahlam Bashiti, Aisha Alansari, Ahmed Ashraf, Nora Alturayeif, Alcides Alcoba Inciarte, Adel Ammar, Abdelrahim A. Elmadany, Mohamedou Cheikh Tourad, Ismail Berrada, Mustafa Jarrar, Shady Shehata, Muhammad Abdul-Mageed

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Mainstream large vision-language models (LVLMs) inherently encode cultural biases, highlighting the need for diverse multimodal datasets. To address this gap, we introduce Pearl, a large-scale Arabic multimodal dataset and benchmark explicitly designed for cultural understanding. Constructed through advanced agentic workflows and extensive human-in-the-loop annotations by 37 annotators from across the Arab world, Pearl comprises over 309K multimodal examples spanning ten culturally significant domains covering all Arab countries. We further provide two robust evaluation benchmarks (Pearl and Pearl-Lite) along with a specialized subset (Pearl-X) explicitly developed to assess nuanced cultural variations. Comprehensive evaluations on state-of-the-art open and proprietary LVLMs demonstrate that reasoning-centric instruction alignment substantially improves models’ cultural grounding compared to conventional scaling methods. Pearl establishes a foundational resource for advancing culturally-informed multimodal modeling research. All datasets and benchmarks are publicly available.

Original languageEnglish
Title of host publicationEMNLP 2025 - 2025 Conference on Empirical Methods in Natural Language Processing, Findings of EMNLP 2025
EditorsChristos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
PublisherAssociation for Computational Linguistics (ACL)
Pages23048-23079
Number of pages32
ISBN (Electronic)9798891763357
DOIs
Publication statusPublished - 2025
Event30th Conference on Empirical Methods in Natural Language Processing, EMNLP 2025 - Suzhou, China
Duration: 4 Nov 20259 Nov 2025

Publication series

NameEMNLP 2025 - 2025 Conference on Empirical Methods in Natural Language Processing, Findings of EMNLP 2025

Conference

Conference30th Conference on Empirical Methods in Natural Language Processing, EMNLP 2025
Country/TerritoryChina
CitySuzhou
Period4/11/259/11/25

Fingerprint

Dive into the research topics of 'Pearl: A Multimodal Culturally-Aware Arabic Instruction Dataset'. Together they form a unique fingerprint.

Cite this