Method for Solving LASSO Problem Based on Multidimensional Weight
Author(s) -
Chunrong Chen,
Shanxiong Chen,
Chen Lin,
Yuchen Zhu
Publication year - 2017
Publication title -
advances in artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 1687-7489
pISSN - 1687-7470
DOI - 10.1155/2017/1736389
Subject(s) - lasso (programming language) , computer science , principal component analysis , regression , algorithm , regression analysis , variable (mathematics) , feature selection , operator (biology) , basis (linear algebra) , selection (genetic algorithm) , relation (database) , component (thermodynamics) , mathematical optimization , artificial intelligence , mathematics , data mining , machine learning , statistics , mathematical analysis , biochemistry , chemistry , geometry , physics , repressor , world wide web , transcription factor , gene , thermodynamics
In the data mining, the analysis of high-dimensional data is a critical but thorny research topic. The LASSO (least absolute shrinkage and selection operator) algorithm avoids the limitations, which generally employ stepwise regression with information criteria to choose the optimal model, existing in traditional methods. The improved-LARS (Least Angle Regression) algorithm solves the LASSO effectively. This paper presents an improved-LARS algorithm, which is constructed on the basis of multidimensional weight and intends to solve the problems in LASSO. Specifically, in order to distinguish the impact of each variable in the regression, we have separately introduced part of principal component analysis (Part_PCA), Independent Weight evaluation, and CRITIC, into our proposal. We have explored that these methods supported by our proposal change the regression track by weighted every individual, to optimize the approach direction, as well as the approach variable selection. As a consequence, our proposed algorithm can yield better results in the promise direction. Furthermore, we have illustrated the excellent property of LARS algorithm based on multidimensional weight by the Pima Indians Diabetes. The experiment results show an attractive performance improvement resulting from the proposed method, compared with the improved-LARS, when they are subjected to the same threshold value
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom