TY - GEN
T1 - DATANARRATIVE
T2 - 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024
AU - Islam, Mohammed Saidul
AU - Laskar, Md Tahmid Rahman
AU - Parvez, Md Rizwan
AU - Hoque, Enamul
AU - Joty, Shafiq
N1 - Publisher Copyright:
© 2024 Association for Computational Linguistics.
PY - 2024/11
Y1 - 2024/11
N2 - Data-driven storytelling is a powerful method for conveying insights by combining narrative techniques with visualizations and text.These stories integrate visual aids, such as highlighted bars and lines in charts, along with textual annotations explaining insights.However, creating such stories requires a deep understanding of the data and meticulous narrative planning, often necessitating human intervention, which can be time-consuming and mentally taxing.While Large Language Models (LLMs) excel in various NLP tasks, their ability to generate coherent and comprehensive data stories remains underexplored.In this work, we introduce a novel task for data story generation and a benchmark containing 1,449 stories from diverse sources.To address the challenges of crafting coherent data stories, we propose a multi-agent framework employing two LLM agents designed to replicate the human storytelling process: one for understanding and describing the data (Reflection), generating the outline, and narration and another for verification at each intermediary step.While our agentic framework generally outperforms non-agentic counterparts in both model-based and human evaluations, the results also reveal unique challenges in data story generation.
AB - Data-driven storytelling is a powerful method for conveying insights by combining narrative techniques with visualizations and text.These stories integrate visual aids, such as highlighted bars and lines in charts, along with textual annotations explaining insights.However, creating such stories requires a deep understanding of the data and meticulous narrative planning, often necessitating human intervention, which can be time-consuming and mentally taxing.While Large Language Models (LLMs) excel in various NLP tasks, their ability to generate coherent and comprehensive data stories remains underexplored.In this work, we introduce a novel task for data story generation and a benchmark containing 1,449 stories from diverse sources.To address the challenges of crafting coherent data stories, we propose a multi-agent framework employing two LLM agents designed to replicate the human storytelling process: one for understanding and describing the data (Reflection), generating the outline, and narration and another for verification at each intermediary step.While our agentic framework generally outperforms non-agentic counterparts in both model-based and human evaluations, the results also reveal unique challenges in data story generation.
UR - https://www.scopus.com/pages/publications/85217761367
U2 - 10.18653/v1/2024.emnlp-main.1073
DO - 10.18653/v1/2024.emnlp-main.1073
M3 - Conference contribution
AN - SCOPUS:85217761367
T3 - EMNLP 2024 - 2024 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference
SP - 19253
EP - 19286
BT - EMNLP 2024 - 2024 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference
A2 - Al-Onaizan, Yaser
A2 - Bansal, Mohit
A2 - Chen, Yun-Nung
PB - Association for Computational Linguistics (ACL)
Y2 - 12 November 2024 through 16 November 2024
ER -