Premium
Learning under nonstationarity: covariate shift and class‐balance change
Author(s) -
Sugiyama Masashi,
Yamada Makoto,
du Plessis Marthinus Christoffel
Publication year - 2013
Publication title -
wiley interdisciplinary reviews: computational statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.693
H-Index - 38
eISSN - 1939-0068
pISSN - 1939-5108
DOI - 10.1002/wics.1275
Subject(s) - weighting , covariate , machine learning , artificial intelligence , cluster analysis , computer science , class (philosophy) , exploratory data analysis , statistical hypothesis testing , sample (material) , supervised learning , statistics , econometrics , mathematics , data mining , artificial neural network , medicine , chemistry , chromatography , radiology
One of the fundamental assumptions behind many supervised machine‐learning algorithms is that training and test data follow the same probability distribution. However, this important assumption is often violated in practice, for example, because of an unavoidable sample selection bias or nonstationarity of the environment. Owing to violation of the assumption, standard machine‐learning methods suffer a significant estimation bias. In this article, we consider two scenarios of such distribution change—the covariate shift where input distributions differ and class‐balance change where class‐prior probabilities vary in classification—and review semi‐supervised adaptation techniques based on importance weighting . WIREs Comput Stat 2013, 5:465–477. doi: 10.1002/wics.1275 This article is categorized under: Statistical Learning and Exploratory Methods of the Data Sciences > Clustering and Classification Statistical Learning and Exploratory Methods of the Data Sciences > Pattern Recognition