TY - JOUR
T1 - FiLM-SimVP
T2 - Scalable Uncertainty Quantification in Spatiotemporal Forecasting
AU - Yoosuf, Shehel
AU - Baali, Hamza
AU - Bouzerdoum, Abdesselam
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2025
Y1 - 2025
N2 - Uncertainty quantification in spatiotemporal forecasting is crucial for decision-making. Quantile regression has been proposed as a computationally efficient and assumption-free approach for uncertainty quantification by generating prediction intervals. Yet, existing deep learning based quantile regression methods struggle to scale efficiently with large datasets. This article introduces FiLM-SimVP, a novel architecture that combines Feature-wise Linear Modulation (FiLM) and recent advances in efficient 2D convolution-based attention mechanisms to improve spatiotemporal forecasting and interval prediction. The proposed approach enables adaptive modulation of spatiotemporal features by directly conditioning intermediate features on confidence levels, allowing the model to learn desired predictive intervals. Through extensive experimentation on three diverse datasets, namely TaxiBJ, Traffic4cast, and WeatherBench, we demonstrate that FiLM-SimVP consistently outperforms existing state-of-the-art (SOTA) methods in point estimation accuracy and interval quality metrics. The model achieves an improvement of 1.1% in Mean Absolute Error and 6% in Mean Squared Error compared to baseline approaches with only slightly increased parameters and computations. Additionally, FiLM-SimVP shows superior scalability when modeling multiple intervals, including the entire conditional distribution, effectively capturing the relationship between different confidence levels without requiring separate models.
AB - Uncertainty quantification in spatiotemporal forecasting is crucial for decision-making. Quantile regression has been proposed as a computationally efficient and assumption-free approach for uncertainty quantification by generating prediction intervals. Yet, existing deep learning based quantile regression methods struggle to scale efficiently with large datasets. This article introduces FiLM-SimVP, a novel architecture that combines Feature-wise Linear Modulation (FiLM) and recent advances in efficient 2D convolution-based attention mechanisms to improve spatiotemporal forecasting and interval prediction. The proposed approach enables adaptive modulation of spatiotemporal features by directly conditioning intermediate features on confidence levels, allowing the model to learn desired predictive intervals. Through extensive experimentation on three diverse datasets, namely TaxiBJ, Traffic4cast, and WeatherBench, we demonstrate that FiLM-SimVP consistently outperforms existing state-of-the-art (SOTA) methods in point estimation accuracy and interval quality metrics. The model achieves an improvement of 1.1% in Mean Absolute Error and 6% in Mean Squared Error compared to baseline approaches with only slightly increased parameters and computations. Additionally, FiLM-SimVP shows superior scalability when modeling multiple intervals, including the entire conditional distribution, effectively capturing the relationship between different confidence levels without requiring separate models.
KW - Quantile regression
KW - probabilistic forecasting
KW - selfsupervised learning
KW - spatiotemporal forecasting
UR - https://www.scopus.com/pages/publications/105018096082
U2 - 10.1109/OJCS.2025.3616224
DO - 10.1109/OJCS.2025.3616224
M3 - Article
AN - SCOPUS:105018096082
SN - 2644-1268
VL - 6
SP - 1575
EP - 1586
JO - IEEE Open Journal of the Computer Society
JF - IEEE Open Journal of the Computer Society
ER -