Premium
Variable selection via additive conditional independence
Author(s) -
Lee KuangYao,
Li Bing,
Zhao Hongyu
Publication year - 2016
Publication title -
journal of the royal statistical society: series b (statistical methodology)
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 6.523
H-Index - 137
eISSN - 1467-9868
pISSN - 1369-7412
DOI - 10.1111/rssb.12150
Subject(s) - consistency (knowledge bases) , independence (probability theory) , conditional independence , selection (genetic algorithm) , feature selection , parametric statistics , flexibility (engineering) , variance (accounting) , variable (mathematics) , mathematics , set (abstract data type) , computer science , statistics , artificial intelligence , mathematical analysis , accounting , business , programming language
Summary We propose a non‐parametric variable selection method which does not rely on any regression model or predictor distribution. The method is based on a new statistical relationship, called additive conditional independence , that has been introduced recently for graphical models. Unlike most existing variable selection methods, which target the mean of the response, the method proposed targets a set of attributes of the response, such as its mean, variance or entire distribution. In addition, the additive nature of this approach offers non‐parametric flexibility without employing multi‐dimensional kernels. As a result it retains high accuracy for high dimensional predictors. We establish estimation consistency, convergence rate and variable selection consistency of the method proposed. Through simulation comparisons we demonstrate that the method proposed performs better than existing methods when the predictor affects several attributes of the response, and it performs competently in the classical setting where the predictors affect the mean only. We apply the new method to a data set concerning how gene expression levels affect the weight of mice.