An improved nonlinear smooth twin support vector regression based‐behavioral model for joint compensation of frequency‐dependent transmitter nonlinearities

In this article, an improved nonlinear smooth twin support vector regression (NSTSVR) model is proposed for the modeling and compensating of the transmitter nonlinearities jointly. The proposed model is an improved version of the twin support vector regression (TSVR) model by introducing a smooth function to replace the loss function of TSVR, which can change the dual space solution to the original space solution and speed up the solving solution. In addition, in order to solve the problem of long training time for large sample data in traditional SVR or TSVR model, the new algorithm further adopts the model pruning techniques, such as deleting the kernel matrix and finding sparse diagonal matrices, to reduce the size of the Hessian matrix in the fast Newton iteration process. To verify the performance of the proposed model, two transmitters based on single‐device gallium nitride (GaN) PA with IQ imbalance and GaN Doherty PA with modulator imperfections are used for experimental verification and analysis. The experimental results show that the proposed model is superior to the conventional support vector regression and TSVR machine learning models in terms of modeling effect and linearization ability. Furthermore, the proposed model can achieve the improved compensation performance for transmitter impairments compared with some popular Volterra series‐based I/Q imbalance models.