Premium
Semi‐supervised covariate shift modelling of spectroscopic data
Author(s) -
Larsen Jacob Søgaard,
Clemmensen Line,
Stockmarr Anders,
Skov Thomas,
Larsen Anders,
Ersbøll Bjarne Kjær
Publication year - 2020
Publication title -
journal of chemometrics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.47
H-Index - 92
eISSN - 1099-128X
pISSN - 0886-9383
DOI - 10.1002/cem.3204
Subject(s) - calibration , covariate , computer science , covariance , extension (predicate logic) , baseline (sea) , multivariate statistics , data mining , linear model , machine learning , mathematics , statistics , oceanography , programming language , geology
Utilizing the full potential of spectroscopic calibrations in changing environments typically requires large amounts of maintenance and/or model updates as the presence of new sources of variation makes the calibration insufficient. In this paper, we propose the use of unlabelled data in order to automize such maintenance. We extend the Linear Joint Trained Framework by Ryan and Culp such that the shifts in mean value and covariance structure are modelled explicitly. The extension yields a more flexible framework, and thus we are able to regularize the final calibration in a more desirable manner. The proposed framework is tested on a simulated dataset where we simulate three different realistic scenarios that are either challenging for classic multivariate calibrations or challenging when adding unlabelled data. Furthermore, we test our framework on two real datasets across multiple data splits. We find that our framework not only achieves the same (and in some instances lower) error level as that of the baseline model (NARE), it also yields better calibration models than the Linear Joint Trained Framework.