CHOOSING THE NUMBER OF REPETITIONS IN THE MULTIPLE PLUG-IN OPTIMIZATION METHOD FOR THE RIDGE PARAMETERS IN MULTIVARIATE GENERALIZED RIDGE REGRESSION
Author(s) -
Isamu Nagai,
Keisuke Fukui,
Hirokazu Yanagihara
Publication year - 2013
Publication title -
bulletin of informatics and cybernetics
Language(s) - English
Resource type - Journals
eISSN - 2435-743X
pISSN - 0286-522X
DOI - 10.5109/1563529
Subject(s) - ridge , multivariate statistics , regression , statistics , mathematics , multivariate analysis , computer science , geology , paleontology
Multivariate generalized ridge (MGR) regression was proposed by Yanagihara, Nagai, and Satoh (2009) in order to avoid the multicollinearity problem in multivariate linear regression models. The MGR estimator is defined by using multiple nonnegative ridge parameters in an ordinary least-squares (LS) estimator. In order to optimize these ridge parameters, Yanagihara, Nagai, and Satoh (2009) and Nagai, Yanagihara, and Satoh (2012) proposed several optimization methods. We focus on the plugin optimization method, which is an estimation method for the principal optimal ridge parameters that minimizes the predicted mean squared error. The plug-in optimization method is a repeating method that uses the current ridge parameters estimate as input in order to obtain an improved estimate. In the present paper, we propose two criteria for choosing the number of repetitions. We conducted several numerical studies using the proposed information criterion to compare the LS and MGR estimators with the optimized ridge parameters based on some ordinary plug-in optimization methods, and those obtained by using the optimized multiple plug-in optimization method.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom