Premium
An autoencoder‐based piecewise linear model for nonlinear classification using quasilinear support vector machines
Author(s) -
Li Weite,
Liang Peifeng,
Hu Jinglu
Publication year - 2019
Publication title -
ieej transactions on electrical and electronic engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.254
H-Index - 30
eISSN - 1931-4981
pISSN - 1931-4973
DOI - 10.1002/tee.22923
Subject(s) - overfitting , autoencoder , computer science , nonlinear system , support vector machine , piecewise linear function , kernel (algebra) , artificial intelligence , piecewise , superposition principle , algorithm , mathematics , artificial neural network , mathematical analysis , physics , geometry , quantum mechanics , combinatorics
In this paper, we propose to implement a piecewise linear model to solve nonlinear classification problems. In order to realize a switch between linear models, a data‐dependent gating mechanism achieved by an autoencoder is designed to assign gate signals automatically. We ensure that a diversity of gate signals is available so that it is possible for our model to switch between a large number of linear classifiers. Besides, we also introduce a sparsity level to add a manual control on the flexibility of the proposed model by using a winner‐take‐all strategy. Therefore, our model can maintain a balance between underfitting and overfitting problems. Then, given a learned gating mechanism, the proposed model is shown to be equivalent to a kernel machine by deriving a quasilinear kernel function with the gating mechanism included. Therefore, a quasilinear support vector machine can be applied to solve the nonlinear classification problems. Experimental results demonstrate that our proposed piecewise linear model performs better than or is at least competitive with its state‐of‐the‐art counterparts. © 2019 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.