TY - JOUR
T1 - Real-Time Player Engagement Measurement Using Nonintrusive Game Telemetry
AU - Rashed, Ammar
AU - Shirmohammadi, Shervin
AU - Hefeeda, Mohamed
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2025
Y1 - 2025
N2 - Player engagement is crucial for the success of modern video games, yet its real-time measurement remains challenging due to the intrusive nature of traditional measurement methods. In this article, we present a novel framework for nonintrusive, real-time, and indirect measurement of engagement in multiplayer online games based on flow theory. Our approach combines graph convolutional networks for modeling player interactions with Transformer networks for temporal processing, enabling indirect measurement of both player skill and game challenge, which in turn are used to classify player engagement. Using playerunknown’s battlegrounds (PUBGs) as a case study, we demonstrate that our framework can effectively measure phase-specific engagement using one minute of gameplay telemetry data. Our framework achieves 73% accuracy and 0.83 ROC-AUC in engagement classification, matching the performance of traditional survey-based methods while operating nonintrusively and in real time. Further cross-domain validation of the framework, as is and without transfer learning, with the games FIFA’23 and Street Fighter V, leads to 66% accuracy, demonstrating the model’s stable performance despite the significant differences in the test domains. Interestingly, our results suggest that objective gameplay metrics may better reflect engagement than subjective player assessments, with skill estimates showing significant correlation with self-reports.
AB - Player engagement is crucial for the success of modern video games, yet its real-time measurement remains challenging due to the intrusive nature of traditional measurement methods. In this article, we present a novel framework for nonintrusive, real-time, and indirect measurement of engagement in multiplayer online games based on flow theory. Our approach combines graph convolutional networks for modeling player interactions with Transformer networks for temporal processing, enabling indirect measurement of both player skill and game challenge, which in turn are used to classify player engagement. Using playerunknown’s battlegrounds (PUBGs) as a case study, we demonstrate that our framework can effectively measure phase-specific engagement using one minute of gameplay telemetry data. Our framework achieves 73% accuracy and 0.83 ROC-AUC in engagement classification, matching the performance of traditional survey-based methods while operating nonintrusively and in real time. Further cross-domain validation of the framework, as is and without transfer learning, with the games FIFA’23 and Street Fighter V, leads to 66% accuracy, demonstrating the model’s stable performance despite the significant differences in the test domains. Interestingly, our results suggest that objective gameplay metrics may better reflect engagement than subjective player assessments, with skill estimates showing significant correlation with self-reports.
KW - Engagement measurement
KW - flow theory
KW - game telemetry
KW - machine learning-assisted measurement
UR - https://www.scopus.com/pages/publications/105003781176
U2 - 10.1109/OJIM.2025.3555326
DO - 10.1109/OJIM.2025.3555326
M3 - Article
AN - SCOPUS:105003781176
SN - 2768-7236
VL - 4
JO - IEEE Open Journal of Instrumentation and Measurement
JF - IEEE Open Journal of Instrumentation and Measurement
M1 - 0b00006493c24fa6
ER -