Skip to main navigation Skip to search Skip to main content

Pearl: A Multimodal Culturally-Aware Arabic Instruction Dataset

  • Fakhraddin Alwajih
  • , Samar M. Magdy
  • , Abdellah El Mekki
  • , Omer Nacar
  • , Youssef Nafea
  • , Safaa Taher Abdelfadil
  • , Abdulfattah Mohammed Yahya
  • , Hamzah Luqman
  • , Nada Almarwani
  • , Samah Aloufi
  • , Baraah Qawasmeh
  • , Houdaifa Atou
  • , Serry Sibaee
  • , Hamzah A. Alsayadi
  • , Walid Al-Dhabyani
  • , Maged S. Al-Shaibani
  • , Aya El Aatar
  • , Nour Qandos
  • , Rahaf Alhamouri
  • , Samar Ahmad
  • Mohammed Anwar Al-Ghrawi, Aminetou Yacoub, Ruwa AbuHweidi, Vatimetou Mohamed Lemin, Reem Abdel-Salam, Ahlam Bashiti, Aisha Alansari, Ahmed Ashraf, Nora Alturayeif, Alcides Alcoba Inciarte, Adel Ammar, Abdelrahim A. Elmadany, Mohamedou Cheikh Tourad, Ismail Berrada, Mustafa Jarrar, Shady Shehata, Muhammad Abdul-Mageed
  • University of British Columbia
  • Prince Sultan University (PSU)
  • Tuwaiq Academy
  • Hadhramout University of Science and Technology
  • Misr University for Science and Technology
  • KFUPM
  • Taibah University
  • WMU
  • UM6P
  • Ibb University
  • Cairo University
  • UCA
  • Qafza Tech
  • JUST
  • King Abdullah University of Science and Technology
  • Damascus University
  • University of Nouakchott
  • Birzeit University
  • Imam Abdulrahman Bin Faisal University
  • Invertible AI

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Mainstream large vision-language models (LVLMs) inherently encode cultural biases, highlighting the need for diverse multimodal datasets. To address this gap, we introduce Pearl, a large-scale Arabic multimodal dataset and benchmark explicitly designed for cultural understanding. Constructed through advanced agentic workflows and extensive human-in-the-loop annotations by 37 annotators from across the Arab world, Pearl comprises over 309K multimodal examples spanning ten culturally significant domains covering all Arab countries. We further provide two robust evaluation benchmarks (Pearl and Pearl-Lite) along with a specialized subset (Pearl-X) explicitly developed to assess nuanced cultural variations. Comprehensive evaluations on state-of-the-art open and proprietary LVLMs demonstrate that reasoning-centric instruction alignment substantially improves models’ cultural grounding compared to conventional scaling methods. Pearl establishes a foundational resource for advancing culturally-informed multimodal modeling research. All datasets and benchmarks are publicly available.

Original languageEnglish
Title of host publicationEMNLP 2025 - 2025 Conference on Empirical Methods in Natural Language Processing, Findings of EMNLP 2025
EditorsChristos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
PublisherAssociation for Computational Linguistics (ACL)
Pages23048-23079
Number of pages32
ISBN (Electronic)9798891763357
DOIs
Publication statusPublished - Nov 2025
Event30th Conference on Empirical Methods in Natural Language Processing, EMNLP 2025 - Suzhou, China
Duration: 4 Nov 20259 Nov 2025

Publication series

NameEMNLP 2025 - 2025 Conference on Empirical Methods in Natural Language Processing, Findings of EMNLP 2025

Conference

Conference30th Conference on Empirical Methods in Natural Language Processing, EMNLP 2025
Country/TerritoryChina
CitySuzhou
Period4/11/259/11/25

Fingerprint

Dive into the research topics of 'Pearl: A Multimodal Culturally-Aware Arabic Instruction Dataset'. Together they form a unique fingerprint.

Cite this