3G: Gaze, Guide, and Grasp: LLM-Augmented Immersive Experiences for Qatar’s Heritage Sites

Cultural heritage sites embody national memory and identity and sustain history, education, and tourism. In Qatar, icons like Al Zubarah Fort and Souq Waqif are assets that demand preservation and engaging access. Yet physical visits and static archives limit interactivity, context, and reach. The 3G project—Gaze, Guide, Grasp—unites Large Language Models (LLMs), immersive XR, and spherical photogrammetry to reinvent heritage engagement. Motivation: (1) Preservation & accessibility—dynamic, explorable digital records for local and global audiences. (2) Engagement & education—LLM-driven conversational XR tailored to user interests. (3) National & global relevance—support Qatar’s cultural tourism and flagship initiatives with AI-aligned platforms. Framework: Gaze—high-res spherical photogrammetry and Gaussian splatting [6] for photorealistic 3D sites. Guide—LLM agents provide context-aware, multilingual (Arabic/English) narratives. Grasp—hands-on interaction with 3D artifacts and scenario-based learning. Led by HBKU’s CSE and CHSS with Qatar Museums, 3G will deliver: AI-enhanced digital twins for VR/mobile/web; LLM heritage guides enabling adaptive, culturally sensitive storytelling; and an interactive knowledge platform for schools, researchers, and visitors. Outcomes include preserved memory, richer learning, stronger tourism, and global visibility—positioning Qatar at the forefront of AI-driven cultural innovation for future generations.

Hamad Bin Khalifa University (HBKU)