Premium
Differential geometric least angle regression: a differential geometric approach to sparse generalized linear models
Author(s) -
Augugliaro Luigi,
Mineo Angelo M.,
Wit Ernst C.
Publication year - 2013
Publication title -
journal of the royal statistical society: series b (statistical methodology)
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 6.523
H-Index - 137
eISSN - 1467-9868
pISSN - 1369-7412
DOI - 10.1111/rssb.12000
Subject(s) - mathematics , generalized linear model , equiangular polygon , algorithm , feature (linguistics) , computation , exponential family , path (computing) , exponential function , linear regression , computer science , statistics , geometry , mathematical analysis , linguistics , philosophy , monotone polygon , programming language
Summary. Sparsity is an essential feature of many contemporary data problems. Remote sensing, various forms of automated screening and other high throughput measurement devices collect a large amount of information, typically about few independent statistical subjects or units. In certain cases it is reasonable to assume that the underlying process generating the data is itself sparse, in the sense that only a few of the measured variables are involved in the process. We propose an explicit method of monotonically decreasing sparsity for outcomes that can be modelled by an exponential family. In our approach we generalize the equiangular condition in a generalized linear model. Although the geometry involves the Fisher information in a way that is not obvious in the simple regression setting, the equiangular condition turns out to be equivalent with an intuitive condition imposed on the Rao score test statistics. In certain special cases the method can be tweaked to obtain L 1 ‐penalized generalized linear model solution paths, but the method itself defines sparsity more directly. Although the computation of the solution paths is not trivial, the method compares favourably with other path following algorithms.