Premium
Determination of optimum number of components in partial least squares regression from distributions of the root‐mean‐squared error obtained by Monte Carlo resampling
Author(s) -
Kvalheim Olav Martin,
Arneberg Reidar,
Grung Bjørn,
Rajalahti Tarja
Publication year - 2018
Publication title -
journal of chemometrics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.47
H-Index - 92
eISSN - 1099-128X
pISSN - 0886-9383
DOI - 10.1002/cem.2993
Subject(s) - mean squared error , mathematics , statistics , calibration , standard deviation , resampling , monte carlo method , partial least squares regression , fraction (chemistry) , chemistry , chromatography
Abstract Monte Carlo resampling is utilized to determine the number of components in partial least squares (PLS) regression. The data are randomly and repeatedly divided into calibration and validation samples. For each repetition, the root‐mean‐squared error (RMSE) is determined for the validation samples for a = 1, 2, … , A PLS components to provide a distribution of RMSE values for each number of PLS components. These distributions are used to determine the median RMSE for each number of PLS components. The component ( A min ) having the lowest median RMSE is located. The fraction p of the RMSE values of A min exceeding the median RMSE for the preceding component is determined. This fraction p represents a probability measure that can be used to decide if the RMSE for the A min PLS component is significantly lower than the RMSE for the preceding component for a preselected threshold ( p upper ). If so, it defines the optimum number of PLS components. If not, the process is repeated for the previous components until significance is achieved. The p upper = 0.5 implies that the median is used for selecting the optimum number of components. The RMSE is approximately normally distributed on the smallest components. This can be utilized to relate p to a fraction of a standard deviation. For instance, p = 0.308 corresponds to half a standard deviation if RMSE is normally distributed. The approach is demonstrated for calibration of metabolomics measurements and spectroscopic mixture data.