Imbalanced Data SVM Classification Method Based on Cluster Boundary Sampling and DT-KNN Pruning
Author(s) -
Peng Li,
Xiao-yang Yu,
Tingting Bi,
Huang Jiuling
Publication year - 2014
Publication title -
international journal of signal processing image processing and pattern recognition
Language(s) - English
Resource type - Journals
eISSN - 2207-970X
pISSN - 2005-4254
DOI - 10.14257/ijsip.2014.7.2.06
Subject(s) - pruning , support vector machine , pattern recognition (psychology) , artificial intelligence , computer science , sampling (signal processing) , cluster (spacecraft) , boundary (topology) , data mining , machine learning , mathematics , biology , computer vision , mathematical analysis , filter (signal processing) , agronomy , programming language
This paper presents a SVM classification method based on cluster boundary sampling and sample pruning. We actively explore an effective solution to solve the difficult problem of imbalanced data set classification from data re-sampling and algorithm improving. Firstly, we creatively propose the method of cluster boundary sampling, using the clustering density threshold and the boundary density threshold to determine the cluster boundaries, in order to guide the process of re-sampling more scientifically and accurately. Secondly, we put forward a new sample pruning algorithm based on dynamic threshold KNN to deal with the complexity and overlapping problem of imbalanced data set. The phenomenon of data complexity and overlapping will reduce the classification performance and generalization ability of SVM classifier. Experiments show that our method acquires obviously promotion effect in various different imbalanced data sets and it can prove the validity and stability.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom