Premium
An Adaptive Two‐stage Estimation Method for Additive Models
Author(s) -
LIN LU,
CUI XIA,
ZHU LIXING
Publication year - 2009
Publication title -
scandinavian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.359
H-Index - 65
eISSN - 1467-9469
pISSN - 0303-6898
DOI - 10.1111/j.1467-9469.2008.00629.x
Subject(s) - estimator , mathematics , additive model , mean squared error , rate of convergence , parametric statistics , kernel regression , dimension (graph theory) , convergence (economics) , function (biology) , mathematical optimization , regression function , kernel (algebra) , parametric model , statistics , computer science , computer network , channel (broadcasting) , combinatorics , evolutionary biology , pure mathematics , economics , biology , economic growth
. In this paper, a two‐stage estimation method for non‐parametric additive models is investigated. Differing from Horowitz and Mammen's two‐stage estimation, our first‐stage estimators are designed not only for dimension reduction but also as initial approximations to all of the additive components. The second‐stage estimators are obtained by using one‐dimensional non‐parametric techniques to refine the first‐stage ones. From this procedure, we can reveal a relationship between the regression function spaces and convergence rate, and then provide estimators that are optimal in the sense that, better than the usual one‐dimensional mean‐squared error (MSE) of the order n −4/5 , the MSE of the order n − 1 can be achieved when the underlying models are actually parametric. This shows that our estimation procedure is adaptive in a certain sense. Also it is proved that the bandwidth that is selected by cross‐validation depends only on one‐dimensional kernel estimation and maintains the asymptotic optimality. Simulation studies show that the new estimators of the regression function and all components outperform the existing estimators, and their behaviours are often similar to that of the oracle estimator.