Premium
Semi‐supervised logistic learning based on exponential tilt mixture models
Author(s) -
Zhang Xinwei,
Tan Zhiqiang
Publication year - 2020
Publication title -
stat
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.61
H-Index - 18
ISSN - 2049-1573
DOI - 10.1002/sta4.312
Subject(s) - logistic regression , artificial intelligence , computer science , machine learning , expectation–maximization algorithm , exponential function , exponential family , equivalence (formal languages) , supervised learning , nonparametric statistics , mathematics , pattern recognition (psychology) , statistics , maximum likelihood , mathematical analysis , discrete mathematics , artificial neural network
Consider semi‐supervised learning for classification, where both labelled and unlabelled data are available for training. The goal is to exploit both datasets to achieve higher prediction accuracy than just using labelled data alone. We develop a semi‐supervised logistic learning method based on exponential tilt mixture models by extending a statistical equivalence between logistic regression and exponential tilt modelling. We study maximum nonparametric likelihood estimation and derive novel objective functions that are shown to be Fisher probability consistent. We also propose regularized estimation and construct simple and highly interpretable expectation–maximization (EM) algorithms. Finally, we present numerical results that demonstrate the advantage of the proposed methods compared with existing methods.