Premium
Soft maximin estimation for heterogeneous data
Author(s) -
Lund Adam,
Wengel Mogensen Søren,
Richard Hansen Niels
Publication year - 2022
Publication title -
scandinavian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.359
H-Index - 65
eISSN - 1467-9469
pISSN - 0303-6898
DOI - 10.1111/sjos.12580
Subject(s) - minimax , estimator , estimation , mathematical optimization , mathematics , minimax estimator , range (aeronautics) , least squares function approximation , noise (video) , computer science , statistics , artificial intelligence , materials science , management , minimum variance unbiased estimator , economics , composite material , image (mathematics)
Extracting a common robust signal from data divided into heterogeneous groups is challenging when each group—in addition to the signal—contains large, unique variation components. Previously, maximin estimation was proposed as a robust method in the presence of heterogeneous noise. We propose soft maximin estimation as a computationally attractive alternative aimed at striking a balance between pooled estimation and (hard) maximin estimation. The soft maximin method provides a range of estimators, controlled by a parameterζ > 0 $$ \zeta >0 $$ , that interpolates pooled least squares estimation and maximin estimation. By establishing relevant theoretical properties we argue that the soft maximin method is statistically sensible and computationally attractive. We demonstrate, on real and simulated data, that soft maximin estimation can offer improvements over both pooled OLS and hard maximin in terms of predictive performance and computational complexity. A time and memory efficient implementation is provided in the R package SMME available on CRAN.