Premium
A bias‐corrected decomposition of the Brier score
Author(s) -
Ferro C. A. T.,
Fricker T. E.
Publication year - 2012
Publication title -
quarterly journal of the royal meteorological society
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.744
H-Index - 143
eISSN - 1477-870X
pISSN - 0035-9009
DOI - 10.1002/qj.1924
Subject(s) - brier score , probabilistic logic , decomposition , reliability (semiconductor) , measure (data warehouse) , forecast skill , econometrics , statistics , event (particle physics) , forecast verification , mathematics , environmental science , computer science , data mining , physics , quantum mechanics , biology , ecology , power (physics)
The Brier score is a widely used measure of performance for probabilistic forecasts of event occurrences and is often decomposed additively into three terms that quantify the reliability and resolution of the forecasts and the uncertainty of the forecast events. The standard decomposition yields biased estimates of the large‐sample values of these three quantities: reliability is overestimated and uncertainty is underestimated, while resolution may be either overestimated or underestimated. An unbiased decomposition is shown to be unattainable but a new decomposition is proposed that has smaller biases and therefore provides a more accurate measure of forecast performance. The implications for the Brier skill score and the attributes diagram are discussed and results are illustrated with seasonal forecasts of sea‐surface temperatures. Copyright © 2012 Royal Meteorological Society