Efficient Probabilistic Tuning of Ensemble Forecasting Method

Alessandro Fanfarillo, Nicholas Malaya, Guido Cervone, Luca Delle Monache

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Ensemble forecasting techniques are gaining popularity in the weather and renewable energy communities, thanks to their ability to produce accurate predictions and at the same time to provide a measure of the uncertainty in the forecast. Analog ensemble techniques are a class of computationally efficient ensemble forecasting methods that predict future weather events based on historical similar cases (i.e., analogs). The definition of "similar"is dependent on the type of predictors used for searching in the historical dataset, and on how relevant they are to identify a similar weather event happened in the past. For a given geographical location, the relevancy of a predictor in identifying good analogs requires a long tuning process usually performed via brute-force. Although highly parallelizable, the brute-force tuning approach becomes unfeasible when large datasets and/or many predictors are used, even on modern supercomputers equipped with powerful accelerators. In this work, we provide several probabilistic alternatives to the tuning process, based on the dataset size, computational cost of a single evaluation, and number of predictors.

Original languageEnglish (US)
Title of host publicationProceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023
PublisherAssociation for Computing Machinery
Pages384-386
Number of pages3
ISBN (Electronic)9798400707858
DOIs
StatePublished - Nov 12 2023
Event2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023 - Denver, United States
Duration: Nov 12 2023Nov 17 2023

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023
Country/TerritoryUnited States
CityDenver
Period11/12/2311/17/23

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this