Premium
Robust forecast aggregation: Fourier L 2 E regression
Author(s) -
Cross Daniel,
Ramos Jaime,
Mellers Barbara,
Tetlock Philip E.,
Scott David W.
Publication year - 2018
Publication title -
journal of forecasting
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.543
H-Index - 59
eISSN - 1099-131X
pISSN - 0277-6693
DOI - 10.1002/for.2489
Subject(s) - categorical variable , brier score , computer science , aggregate (composite) , rank (graph theory) , statistics , regression , econometrics , logistic regression , artificial intelligence , algorithm , machine learning , mathematics , materials science , combinatorics , composite material
The Good Judgment Team led by psychologists P. Tetlock and B. Mellers of the University of Pennsylvania was the most successful of five research projects sponsored through 2015 by the Intelligence Advanced Research Projects Activity to develop improved group forecast aggregation algorithms. Each team had at least 10 algorithms under continuous development and evaluation over the 4‐year project. The mean Brier score was used to rank the algorithms on approximately 130 questions concerning categorical geopolitical events each year. An algorithm would return aggregate probabilities for each question based on the probabilities provided per question by thousands of individuals, who had been recruited by the Good Judgment Team. This paper summarizes the theorized basis and implementation of one of the two most accurate algorithms at the conclusion of the Good Judgment Project. The algorithm incorporated a number of pre‐ and postprocessing steps, and relied upon a minimum distance robust regression method called L 2 E . The algorithm was just edged out by a variation of logistic regression, which has been described elsewhere. Work since the official conclusion of the project has led to an even smaller gap.