Premium
Online eigenvector transformation reflecting concept drift for improving network intrusion detection
Author(s) -
Park Seongchul,
Seo Sanghyun,
Jeong Changhoon,
Kim Juntae
Publication year - 2020
Publication title -
expert systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.365
H-Index - 38
eISSN - 1468-0394
pISSN - 0266-4720
DOI - 10.1111/exsy.12477
Subject(s) - computer science , principal component analysis , transformation (genetics) , eigenvalues and eigenvectors , concept drift , data mining , intrusion detection system , online and offline , artificial intelligence , data stream mining , precision and recall , pattern recognition (psychology) , machine learning , biochemistry , chemistry , physics , quantum mechanics , gene , operating system
Currently, large data streams are constantly being generated in diverse environments, and continuous storage of the data and periodic batch‐type principal component analysis (PCA) are becoming increasingly difficult. Various online PCA algorithms have been proposed to solve this problem. In this study, we propose an online PCA methodology based on online eigenvector transformation with the moving average of the data stream that can reflect concept drift. We compared the network intrusion detection performance based on online transformation of eigenvectors with that of offline methods by applying three machine learning algorithms. Both online and offline methods demonstrated excellent performance in terms of precision. However, in terms of the recall ratio, the performance of the proposed methodology with integrated online eigenvector transformation was better; thus, the F1‐measure also indicated better performance. The visualization of the principal component score shows the effectiveness of our method.