Premium
A Necessary Condition for the Strong Oracle Property
Author(s) -
Kim Yongdai,
Jeon JongJune,
Han Sangmi
Publication year - 2016
Publication title -
scandinavian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.359
H-Index - 65
eISSN - 1467-9469
pISSN - 0303-6898
DOI - 10.1111/sjos.12195
Subject(s) - oracle , property (philosophy) , estimator , mathematics , maxima and minima , function (biology) , regular polygon , mathematical optimization , computer science , statistics , mathematical analysis , geometry , philosophy , software engineering , epistemology , evolutionary biology , biology
A problem of using a non‐convex penalty for sparse regression is that there are multiple local minima of the penalized sum of squared residuals, and it is not known which one is a good estimator. The aim of this paper is to give a guide to design a non‐convex penalty that has the strong oracle property. Here, the strong oracle property means that the oracle estimator is the unique local minimum of the objective function. We summarize three definitions of the oracle property – the global, weak and strong oracle properties. Then, we give sufficient conditions for the weak oracle property, which means that the oracle estimator becomes a local minimum. We give an example of non‐convex penalties that possess the weak oracle property but not the strong oracle property. Finally, we give a necessary condition for the strong oracle property.