Premium
The Role of Regression Performance on Multimodel Analysis
Author(s) -
Foglia L.,
Mehl S.W.
Publication year - 2013
Publication title -
groundwater
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.84
H-Index - 94
eISSN - 1745-6584
pISSN - 0017-467X
DOI - 10.1111/gwat.12144
Subject(s) - computer science , calibration , inversion (geology) , regression , inverse , nonlinear system , machine learning , regression analysis , inverse problem , data mining , artificial intelligence , statistics , mathematics , paleontology , mathematical analysis , physics , geometry , structural basin , quantum mechanics , biology
In this work, we provide suggestions for designing experiments where calibration of many models is required and guidance for identifying problematic calibrations. Calibration of many conceptual models which have different representations of the physical processes in the system, as is done in cross‐validation studies or multi‐model analysis, often uses computationally frugal inversion techniques to achieve tractable execution times. However, because these frugal methods are usually local methods, and the inverse problem is almost always nonlinear, there is no guarantee that the optimal solution will be found. Furthermore, evaluation of each inverse model's performance to identify poor calibrations can be tedious. Results of this study show that if poorly calibrated models are included in the analysis, simulated predictions and measures of prediction uncertainty can be affected in unexpected ways. Guidelines are provided to help identify problematic regressions and correct them.