Premium
Predicting weather forecast uncertainty with machine learning
Author(s) -
Scher Sebastian,
Messori Gabriele
Publication year - 2018
Publication title -
quarterly journal of the royal meteorological society
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.744
H-Index - 143
eISSN - 1477-870X
pISSN - 0035-9009
DOI - 10.1002/qj.3410
Subject(s) - predictability , numerical weather prediction , forecast skill , computer science , machine learning , initialization , weather forecasting , probabilistic forecasting , ensemble forecasting , artificial intelligence , weather prediction , model output statistics , range (aeronautics) , data assimilation , meteorology , mathematics , statistics , geography , engineering , aerospace engineering , probabilistic logic , programming language
Weather forecasts are inherently uncertain. Therefore, for many applications forecasts are only considered valuable if an uncertainty estimate can be assigned to them. Currently, the best method to provide a confidence estimate for individual forecasts is to produce an ensemble of numerical weather simulations, which is computationally very expensive. Here, we assess whether machine learning techniques can provide an alternative approach to predict the uncertainty of a weather forecast given the large‐scale atmospheric state at initialization. We propose a method based on deep learning with artificial convolutional neural networks that is trained on past weather forecasts. Given a new weather situation, it assigns a scalar value of confidence to medium‐range forecasts initialized from the said atmospheric state, indicating whether the predictability is higher or lower than usual for the time of the year. While our method has a lower skill than ensemble weather forecast models in predicting forecast uncertainty, it is computationally very efficient and outperforms a range of alternative methods that do not involve performing numerical forecasts. This shows that it is possible to use machine learning in order to estimate future forecast uncertainty from past forecasts. The main constraint in the performance of our method seems to be the number of past forecasts available for training the machine learning algorithm.