TY - JOUR
T1 - A Bayesian approach to quantifying uncertainties and improving generalizability in traffic prediction models
AU - Sengupta, Agnimitra
AU - Mondal, Sudeepta
AU - Das, Adway
AU - Guler, S. Ilgin
N1 - Publisher Copyright:
© 2024 Elsevier Ltd
PY - 2024/5
Y1 - 2024/5
N2 - Deep-learning models for traffic data prediction can have superior performance in modeling complex functions using a multi-layer architecture. However, a major drawback of these approaches is that most of these approaches do not offer forecasts with uncertainty estimates, which are essential for traffic operations and control. Without uncertainty estimates, it is difficult to place any level of confidence in the model predictions, and operational strategies relying on overconfident predictions can lead to worsening traffic conditions. In this study, we propose a Bayesian recurrent neural network framework for uncertainty quantification in traffic prediction with higher generalizability by introducing spectral normalization to its hidden layers. In our paper, we have shown that normalization alters the training process of deep neural networks by controlling the model's complexity and reducing the risk of overfitting the training data. This, in turn, helps improve the generalization performance of the model on out-of-distribution datasets. Results demonstrate that spectral normalization improves uncertainty estimates and significantly outperforms both the layer normalization and model without normalization in both single and multistep prediction horizons. This improved performance can be attributed to the ability of spectral normalization to better localize the latent feature space of the data under perturbations. Our findings are especially relevant to traffic management applications, where predicting traffic conditions across multiple locations is the goal, but the availability of training data from multiple locations is limited. Spectral normalization, therefore, provides a more generalizable approach that can effectively capture the underlying patterns in traffic data without requiring location-specific models.
AB - Deep-learning models for traffic data prediction can have superior performance in modeling complex functions using a multi-layer architecture. However, a major drawback of these approaches is that most of these approaches do not offer forecasts with uncertainty estimates, which are essential for traffic operations and control. Without uncertainty estimates, it is difficult to place any level of confidence in the model predictions, and operational strategies relying on overconfident predictions can lead to worsening traffic conditions. In this study, we propose a Bayesian recurrent neural network framework for uncertainty quantification in traffic prediction with higher generalizability by introducing spectral normalization to its hidden layers. In our paper, we have shown that normalization alters the training process of deep neural networks by controlling the model's complexity and reducing the risk of overfitting the training data. This, in turn, helps improve the generalization performance of the model on out-of-distribution datasets. Results demonstrate that spectral normalization improves uncertainty estimates and significantly outperforms both the layer normalization and model without normalization in both single and multistep prediction horizons. This improved performance can be attributed to the ability of spectral normalization to better localize the latent feature space of the data under perturbations. Our findings are especially relevant to traffic management applications, where predicting traffic conditions across multiple locations is the goal, but the availability of training data from multiple locations is limited. Spectral normalization, therefore, provides a more generalizable approach that can effectively capture the underlying patterns in traffic data without requiring location-specific models.
UR - http://www.scopus.com/inward/record.url?scp=85190263518&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85190263518&partnerID=8YFLogxK
U2 - 10.1016/j.trc.2024.104585
DO - 10.1016/j.trc.2024.104585
M3 - Article
AN - SCOPUS:85190263518
SN - 0968-090X
VL - 162
JO - Transportation Research Part C: Emerging Technologies
JF - Transportation Research Part C: Emerging Technologies
M1 - 104585
ER -